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FOREWORD 


Tliis  report  covers  the  work:  performed  during  the,, period  Februaiy  - 
December  1960  by  the  Cornell  Aeronautical  Laboratory,  Inc.,  Buffalo,  New  York, 
under  Air  Force  Contract  AF30(602)-2210.  The  contract  was  initiated  by  the 
Advanced  Development  l,aboratory.,,of  the  M.rectorate  of  Communications,  the 
Rome  Air  Development  Center,  Grlffiss  Air  Force  Base,  New  York.  The  work 
was  jierformed  under  the  cognizance  and  direction  of  Mr,  Alfred  S.  Kobos. 

"  Tne  assistance  and  encouragement  received  from  RADC  personnel.  In  p^\rticular 
Messrs.  Miles  H.  Bickelhaupt,  Alfred  S.  Kobos  and  Lt»  Jack  K.  Wolf,  is: grate¬ 
fully,  acknowledged.  ,  , 

The  mateilal  which  is  presented  ih  this  report  is  the  result  of  the  Joint 
efforts  of  the  personnel  assigned  to  this  project  at  the  Cornell  Aeronautical 
Laboratory,.  The  Project  Engineer  at  the  C.A.L.  is  Dr.  John  Q.  Lawton  and  the 
major  contributors  to  this  effort  ares' ..Messrs,  Harold  D.  Becker,  Ting  T.  Chang, 
Richard  E,  Cleary,  Eugene.A.  Trabka,  Ned  B.  Sinith'i 


ii 


ABSTRACT 


This  report  oov'^rs  analyses  on  a  variety  of  topics  related  to  the  trans- 
i^iission  of  ciigital  data.  The  perfpiTrtance  of  several  types  of  Pliase  3-::' 't 
Keyed  (  PSK)  systems,  as  determined'' by  the  relationship  of  the  error  prpbaMlity 
tf'  rd^nal-to-noiso  ratio,  is  examined.  Coherent,  differentially  coherent, 
blriSi"  and  m-state  PSK  systeviis,  and  ths  effects  of  frequency  offset,  cross- 
tall;  and  tliermal  noise  on  the  perfoinance  of  these  systems  are  considered., 

"I'.o  porroi-mance  of  m- state  differentially  coherent-  muitiplex.ed  : PSK  data  links  - 

operatinr  over  a  Rayleigh  fading  troposnheric  scatter  link  is ■analvzed. 

'■  „  i"  /  -  .  -y,  ' 

Tivo  .properties  of  Impulse  noise  are  examined  and  the';,effect  of.  impulse  noise 
•■'o- '.ugital  systems  using  eibse-packed- codes  -are  investigated. 


"Moment  .detectioti.”,"  which  refers  to  a  decision-  techni  cue  barred  on -the.. 


4asioiiitewpGral_moment8->-— of  -the  reeMved  ^waydf 
is  investigftte.d-K’Oth  analytically  ahd  experl-mentally,. 
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I. 


INTRODUCTION 


The  need  for  rapid,  reliable,  digital  cbininunications  systems  spanning 
'■■er  ■  Ifirge  distances,  has  assumed  great  importance  during  the  last  few  years, 
.n  some  cases,  such  as  the  telemetering  of  data  from  .space,  probes,  it  has  been 
practical  to  design  the  digital  coftmunications  syste^  "from  the  ground  up'*-  for 
the  par.ticular  task  at  h^nd.  In  other  cases,  such  as  the  .transmission  of  data 
over  long  distance  telephone  facilities,  the,  economic  necessity  of  utilizing 
the  vast  exis.ting  plant  imposes  particular  restrictions  on  the  data  system  i.em- 
.plpyed."  . 


In  view  of  the  fundamental  differences  of  the  various  environnShts  en¬ 
countered,  it  has  not  been  possible  to  conceive  of  a  universally  suitable 


digital  ccmmunicatd.ono  system.  Even  for  a  single  environment,  the  precise 
fbrm  whiohha'ri  ■nopiimunr'  ;8j^1^  is,  in  general,  unknown}  in  fact, 


flgyQfifftont  dn^w^t  constitutes  hn  pptimuinjByS^^  bsi 

■diifer6h't'''digiLta£ 

communications  systems  does,  not  exist,  it  is  often  possible  to  oompare  systems 
&n-fl  relatl",  3  or  "all  other  pafameters -'bSslng  equal"  basis-.  -  '  ' 


m^present -report  eftvers  that -part  of^a  -'cbntinuing  invesU^^^  of  - 
methods  for  the  transmissidn' and  delection-of  digital  data  which  was  performed 

dur-ing- -the  -  period-  February—  -December ' I960 ,  "und er  Air  Force  Contract' - ; - 

-No.  -AF-3Q(6Q2.) -gll.O,.. .  contract  is  ooiu^rned  with  a  variety  of  fundamental 
Investigations  ^i;hich  fall  into  the-following  two  broad  categories: 

1)  Investigations  aimed  at  determining  the  limitations  djnpossd  on  the 
^performance  of  various  systems  by  deXeterlous  phehbmena7  sucVTas 
fading,  phase  distortion,  noise,  synchronization  errors,  etc. 

^  2)  The  postulation  and/or  examination  of  promising  new  techniques,  such 
-t  /  as  m-state  (as  distinguished  from  2-.stat0  or  binary)  digital  com¬ 
munications  systems,  new  modulation  and  decision  techniques,  etc. 


As  several  of  the  topics  covered  are  not  closely  related,  and  since 
they  were  treated  by  separate  investigations,  they  are  reported  herein  by 
means  of  independent  Chapte-r.T  and  Appendices.  Major  project  effort 


vias  devoted  to  these  separate  studies,  and  their  resulwS  and  derivations  were 
documented  in  DETECT^  memoranda  upon  completion  of  the  individual  studies.  In 
view  of  the  above,  it  seems  appropriate  to  restrict  the  body  of  this  report 
primarily  to  a  summary  of  the  results  obtained  and  to  leave  the  derivations  of 
these  results  in  the  DETECT  memoranda  which  form  appendices  of  this  report. 

This  Laboratory  had  under  a  previous  contract,  AF  30(602 )-1702,  in¬ 
vestigated  the  performance  of  various  binary  data  transmission  systems  in  the 
presence  of  additive  white  Gaussian  noise.  A  major  portion  of  that  analysis 
was  concerned  with  coherent  and  differentially  coherent  binary  phase-shift 
keyed  systems.  Under  the  present  contract,  this  analysis  has  been  extended 
to  cover! 

a)  multiple  state  as  well  as  binary  phase-shift  keyed  systems; 

'  }  . 

b)  the  effects  of  frequency  offset  between  transmitter  and  receiver, 
synchronization  errors,  and  crosstalk; 

c)  various  embodiments  of  receivers  for  the  reception  of  these  signals* 
The  results  of  this  phase  of  the  work  are  reported  in  Chapter  II  of 

I’. 

this  report,  while  the  derivations  and  proofs. are  contained  in  Appendix  I. 

y' 

Ctiapter  III  report.**  the  results  of  applying  the  above  analysis  to 
the  investigation  of  the  performance  of  digital  data  links  in  which  DCPSK 
channels  are  multiplexed  and  transmitted  over  s  Rayleigh  fading  tropo¬ 
spheric  scatter  link.  Appendix  II  contains  the  derivation  of  these  results. 

Chapter  IV  is  devoted  to  comments  on  an  article  entitled,  "Ideal 
Binary  Pulse  Transmission  by  AM  and  FM,"*^**  which  reached  conclusions  in¬ 
compatible  with  prior  work  at  this  Laboratory. 


Effort  under  this  contract  has,  within  the  Cornell  Aeronautical  Laboratory, 
been  designated  as  Project  DETECT. 

See  Bibliography  -  Becker  I. 
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+K!-* 


Sunde  I. 


Chapiter  V  discusses  some  of  the  properties  of  impulse  noise  and  re¬ 
ports  'he  results  of  an  investigation  of  the  effects  of  impulse  noise  on  the 
error  probability  of  digital  communications  systems  usinp;  close-packed  codes. 
Appendix  III  contains  the  derivations  of  the  results  noted  in  that  chapter • 

"Moment  detection"  is  the  name  given  to  a  decision  technique  based  on 
the  utilization  of  temporal  moments  by  a  group  at  Rutgers  University  who  pro¬ 
posed  this  technique.  Under  the  present  program,  the  performance  attainable 
by  "moment  detection"  has  bean  investigated  both  analytically  and  experimentally 
The  results  of  these  investigations  are  reported  in  Chapter  VI  of  this  report 
and  the  derivations  and  proofs  are  contained  in  Appendix  IV. 

Because  material  contained  in  the  appendices,  most  of  which  was  origi¬ 
nally  issued  in  DETECT  memorancla,  was  written  by  various  aMpkora,  the  meaning 
of  symbols  may  vary  somewhat  among  the  appendices..  A  consistent  notation  is, 
however,  used  in  every  individual  appendix  ar^  throughout  the  body  of  this 
report.  It  was  felt  that/  any  attempt  to  change  notation  so  as  to  enforce  com¬ 
plete  consistency  would  probably  be  unsuccessful.  In  several  instances  it  was 
felt  desirable  to  make  changes  in  DETECT  memoranda  before  incorporating  them 
into  the  appendices  of  this  report;  such  memoranda  are  identified  by  the  letter 
"A"  after  the  memorandum  number. 
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II. 


W'liVI.YSIS  OF  PHASE-SHIFT  KEYED  SYSTEMS 


Previous  analyses'  have  shewn  that  among  binary  systems  operating  in  the 
presence  of  white  Gaussian  noise,  phase-shift  keyed  s3rstoins  attain  smaller 
error  probabilities  than  other  systems.  Differentially  coherent  phase-shift 
keyed  systems'”  are  currently  in  use  or  contemplated  for  use  over  wire  lines, 
H.F.  radio,  and  troposcatter  links  and  PSK  systems  using  phase-looked  loops 
have  been  used  for  telemetry  from  space  probes. 

Since,  in  practice,  these  systems  often  do  not  use  a  binary  alphabet 
and  are  subject  to  disturbances  other  than  white  Gaussian  noise,  it  is  of 
interest  to  investigate  phase-shift  keyed  systems  further.  This  report  extends 
the  analyses  to  include  m-state  coherent  phase-shift  keyed  (CPSK)  and  differ¬ 
entially  coherent  phase-shift  keyed  (DCPSK)  systems,  as  well  as  the  effects 
of  synohroniaation  errors  and  frequency  offset  between  transmitter  and  receiver. 
Details  of  the  analyses  which  have  been  performed  on  these  systems  will  be 
found  in  Appendix  I  and  the  results  obtained  there  are  discussed  below. 

Figure  II-l  is  a  phasor  representation  of  the  transni'Jted  signals 
(characters)  of  an  m-state  PSK  system  for  the  case  m  ■  8.  In  the  case  of 
CPSK  systems,  the  reference  phasor  represents  an  absolute  reference,  whereas 
in  the  case  of  a  DCPSK  system  it  represents  the  phase  of  the  signal  transmitted 
during  the  previous  signal  interval.  Note  that  it  is  not,  in  general,  possible 
to  distinguish  CPSK  from  DCPSK  signals  without  additional  information. 


i;-  Decker  I,  Reiger  I,  Cahn  I. 

■i;-::-  A  coherent  phase-shift  keyed  system  is  one  in  wnich  the  absolute 
phase  of  the  signal  corresponds  to  the  data;  a  differentially 
coherent  phase-shift  keyed  system  is  one  where  the  phase  difference 
between  successive  signals  corresponds  to  the  data, 

Taber  I,  Sanders  I 


h 
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Figure  n<l  PHA30R  REPRESENTATION  OFm-STATE  PSK  SIGNALS 

I 


Fig\ire  II-2  la  a  block  diagram  of  an  m-state  PSK  transmitter.  An 
oscillator  produces  a  continuous  sinusoidal  wavs  form  whldh  is  phase-shifted 
so  that  the  m  phase-shifted  signals  shown  in  Figure  11-1  are  applied  to  the 
input  of  m  gates.  The  gates  are  control.led  by  a  logic  circuit  such  that  only 
one  gate  is  open  during  any  signal  interval.  The  logic  circuit  soleots  the 
proper  gate  in  accordance  with  the  input  data  and  whether  CPSK  or  DCPSK  operation 
is  desired.  Synchronization  of  the  data  rate  and  gate  operation  is  required 
and  may  be  performed  either  externally  or  within  the  logic  circuit.  The  oper¬ 
ating  frequency  may  also  be  related  to  the  signalling  speed''  such  that 
each  signal  interval  contains  an  Integral  number  of  cycles.  If  there  are 


Signalling  speed  is  defined  as  the  rate  at  which  elementary  signals  are 
transmitted  regardless  of  the  Infoimation  content,  thus  an  m  "  8  state 
system  operating  at  a  signalling  speed  of  1000  baud  would  have  a  signal 
duration  of  1  millisecond  and  could  convey  at  most  1000  log,  8  -  3000 
bits  of  information  per  second,  ‘ 
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Figure  n-2  BLOCK  DIAORAH  OF  m  -STATE  PSK  TRANSMITTER 


an  Integral  number  of  cycles  per  signal  Interval,  certain  aspects  of  the 
analysis  are  greatly  facilitated.  This  assumption  has  been  made  in  several 
places  in  the  analyses  but  is  not  required  in  the  proof  of  the  major  results 
obtained  in  connection  with  DCPSK  systems. 

It  is  possible  to  conceive  of  a  F6K  system  which  operates  in  a  manner 
somewhat  different  from  the  system  described  above.  In  order  to  distinguish 
between. these  systems,  the  system  described  above  will  be  called  a  gated  PSK 
system,  since  the  transmitted  signals  are  obtained  by  gating  of  continuous 
phase-shifted  sinusoids,  and  the  alternate  system  will  be  called  a  pulsed 
PSK  system.  In  an  m-state  pulsed  KiK  system  the  signals  are  pulsed  sinusoids 
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m  f^i.stinct  starting  phases.  The  difference  between  the  signals  of  these 
systems  is  ix.  trated  in  Figure  TI-3. 


Figure  H-S  WAVEFORMS  PRODUCED  BY  UNCHANQINQ  DATA  IN  PSK  SYSTEMS 


If  each  signal  interval  contains  an  integral  numbei*  of  cycles,  then  / 
the  tvro  PSK  systema  dre  equivalent,  otherwise  the  two  systems  are  not 
strictly  equivalent.  In  narticular,  it  is  possible  to  consider  the  pulsed 
CPDK  system  operating  with  a  frequency  difference  between  transmitter  and 
receiver.  Operation  can  be  na.Lntained  in  the  presence  of  an  unknown  frequency 
difference  only  if  starting  phase  coherence  is  maintained.  This  may  be  the 
case,  for  instance,  when  the  frequency-determining  elements  of  the  transmitter 
and  receiver  are  "detuned"  with  respect  to  each  other,  but  would  not  be  the 
case  when  the  frequency  difference  is  due  to  "offset"  of  heterodyning  oscil¬ 
lators,  This  does  not  apnear  reasonable  for  the  gated  CPRK  system  because, 
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in  this  system,  a  phase  error  would  accumulate  in  accordance  with  -  /  ^aoMdv 

*'0 

In  practice,  where  frequency  errors  occur  with  a  gated  CPSK  system,  some  power 
is  transmitted  at  the  carrier  frequency  to  establish  a  phase  reference,  and  a 
frequency-following  scheme  using  a  phase-locked  loop  is  usually  employed. 

It  is,  of  course,  necessary  that  the  transmitter  and  receiver  of  a  PSK 
system  be  designed  so  as  to  be  compatible,  i.e.,  both  components  must  be  de¬ 
signed  either  for  gated  or  pulsed  PSK  operation,  fi-om  an  analytical  point  of 
view,  these  systems  are  equivalent  to  a  considerable  extent  and  closely  analo¬ 
gous  embodiments  of  the  various  receivers  are  possible.  As  far  as  is  known, 
only  gated  CF5K  systems  have  been  used  in  practice.  This  is  probably  due  to 
the  greater  simplicity  of  the  resulting  hardware  and  the  ability  to  approach 
the  performance  of  a  true  coherent  system  by  the  use  of  a  transmitted  reference 
signal. 

Sections  (a)  and  (b)  of  Appendix  I  describe  several  embodiments  of  the 
maximum  likelihood  receiver  for  the  detection  of  CR3K  signals  in  white  Gaussian 
noise.  - 


Figure  Il-h  shows  the  block  diagram  of  the  cross -correlation  embodiment 
of  a  maximum  likelihood  receiver  based  on  the  theory  of  these  receivers  as  de¬ 
scribed  in  Appendix  1(c)  and  by  several  other  authors.* 


Woodward  I,  Peterson  I,  Davenport  I 


CORRELATOR 


Figure  II-4  CROSS-CORRELATION  mBODIMENT  OF  MAXIMUM  LIKELIHOOD  RECEIVER 


Figure  II-5  is  the  block  diagram  of  a  matched  filter  embodiment.  This 
receiver  is  applicable  to  the  pulsed  CPSK  systems  and  to  the  gated  CPSK  systems 
only  if  each  signal  interval  contains  exactly  an  integral  number  of  cycles  and 
the  start  of  the  signal  intervals  is  phase-locked  to  the  reference  signal  phase, 
if  each  signal  intarval  of  a  gated  CPSK  system  does  not  contain  an  integral 
number  of  cycles,  then  the  signals  contained  in  adjacent  signal  intervals  will 
differ  in  their  respective  starting  phases,  even  when  the  data  coiresponding  to 
the  two  signal  intervals  does  not  change.  This  would  require  that  different 
matched  filters  be  used  for  adjacent  signal  intervals  and  make  the  matched  filter 
embodiment  rather  impractical,.  The  transmitter,  Figure  II-2,  and  the  cross - 
correlation  receiver,  Figure  II-U,  however,  do  not  require  an  integral  number 
of  cycles  per  signal  Interval. 

Upon  noting  the  m-fold  repetition  of  most  of  the  components  of  the  cross- 
correlation  and  the  matched  filter  receivurs  (Figures  II-U  and  11-5),  one  is 
lad  to  Inquire  whether  equivalent  perfqrmance  could  not  be  obtained  from  a 
simpler  receiver.  Figure  II-6  shows  the  block  diagram  of  a  more  practical 
receiver,  the  performance  of  vihieh  approaches  that  of  a  true  maximum  likelihood 
receiver  if  the  number  of  cycles  par  signal  interval  is  large. 

If  oOgT  >>  2Tt  the  error  probability  of  the  n-state  CPSK  system  is 
given  by 

du, 

Ia-21^ 


It  has  been  possible  to  evaluate  the  integral  in  Eq,  Ia-21  in  closed  form 
only  for  m  ■  2  and  I4  yielding 


The  notation  Ia-21,  etc,,  indicates  that  this  equation  is  derived  in 
Appendix  la  and  is  there  designated  as  Equation  21, 
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Figure  II-5  MATCHED  FILTER  EMBODIMENT  OF  MAXIMUM  LIKELIHOOD  RECEIVER 


Figure  11-6  A  "PRACTiCAL"  RECEIVER 
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P{'^}  -  ^  2  2  4 

where  E . Signal  Energy  (joules)  per  signal  intejnral 

No,,,. .Noise  power  density  (vratts  per  cps)  of  the  one-sided 
spectrum 


Gilbert^'  has  obtained  an  approximate  formula  for  the  error  probability 
of  coherent  systems  vrtiich  is  valid  for  ^ 'fn  ^  ^  •  Although  Gilbert  did  not 

specifically  consider  PSK  sj'stems,  his  approach,  which  is  discussed  in  Appendix 
1(c),  may  be  applied  to  these  systems  and  yields 

^  ^ . 

It  is  always  of  interest  to  determine  the  sensitivity  of  a  system  to 
disturbances,  or  operation  under  conditions  differing  from  those  for  which 
it  was  designed.  Frequently  it  is  not  possible  to  carry  through  a  statistically 
optimized  design  because  the  necessary  statistics  are  not  available.  Under 
these  conditions,  knowledge  of  the  sensitivity  to  variation  of  various 
pai'ameters  can  be  valuable.  In  this  vein  the  sensitivities  of  the  cross- 
correlation  (Figure  II-U),  the  matched-filter  (Fig\a*e  II-5),  and  the  practical 
(Figure  II-6)  receivers  to  timing  errors  of  the  synchronization  between 
transmitter  and  receiver  were  examined.  Although  these  receivers  give 
equivalent  performance  in  the  absence  of  synchronization  errors,  it  is  found 
that  the  matched-filter  receiver  is  more  sensitive  to  synchronization  errors 
than  the  cross-correlation  or  the  "practical”  receivers.  An  equation  for 
the  error  probability  of  the  m-state  "practical"  receiver  in  the  prestnce  of 
timing  errors  is  derived  in  AnpencHx  1(d), 

Gilbert  I 
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For  m 


2  this  equation  reduces  to 


Id-16 

Id-21 


P(Z)  - 


which  also  applies  to  the  two-state  cross-correlation  receiver  as  is  shown  in 
Anpendix  T(b),  However,  the  probability  of  error  of  the  matched-filter  receiver 
under  t}iese  conditions  is 


It  will  be  noted  that  (for  large  F./H^)  the  error  probability  of  the 
cross-correlation  and  practical  receivers  is  much  less  sensitive  to  \^t\ 
than  is  the  error  probability  of  the  matched-filter  receiver,  PC2)  as 'given 
by  Equation  Id-21  is  monotonic  vdth  while  P(2)  as  given  by 

Equation  Id-28  is  oscillatorj'.  This  behavior  is  plausible  on  physical  grounds. 
It  is  a  manifestation  of  the  characteristics  of  the  output  voltage  of  the 
matched  filter  which  oscillates  with  relatively  constant  phase  at  its  resonant 
frequency.  Hence,  uhe  error  probability  of  the  matched-filter  receiver,  which 
bases  its  decision  on  outnut  voltage,  reflects  this  oscillatory  nature,  whereas 
the  error  probability  of  the  "practical"  receiver,  which  bases  its  decision  on 
output  phase,  reflects  the  more  steady  nature  of  the  output  phase.  In  the 
case  of  the  cross-correlation  receiver  the  output  is  governed  primarily  by  the 
degree  of  overlap  between  the  received  signal  and  the  interval  of  integration. 


Although  the  analysis  was  not  carried  out  for  m  ^  2,  the  above  arguments 
indicate  that  the  cross-correlation  and  the  practical  receiver  will  retain 
their  smaller  sensitivity  to  compared  to  the  matched-filter  receiver 

for  m  /  2.  A  description  of  a  particular  realization  of  the  "practical" 
receiver  will  be  found  in  Asipendix  1(d).  The  receiver  wh.ich  is  there  described 
uses  an  "integrate  and  dump"  technique  for  the  realization  of  the  matched  filter 
and  a  zero-crossing  phase  detector  for  the  determination  of  the  phase  of  the 
filter  output. 
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comnariron  of  the  oerformr.nce  of  the  matched -filter  and  the  "practical" 
receivers  onerated  in  a  nulsed  nyrtem  shows  that  these  receivers  give 

identical  performance  in  the  presence  of  freciuency  error  “  (and  zero  timing 
error) .  Apnendix  1(d)  derives  a  formal  expression  for  the  error  nrobability  of 
an  m-state  "practical"  receiver  operating  in  the  nresence  of  sampling  time  and 
frequency  errors,  This  expression  is  evaluated  for  m  =  2.  The  corresponding 
expression  for  the  matched -filter  receiver  yields  eqr.ivalent  nerformance  only 
if  Zl  7  =  7^  =  an  integer. 

It  is  well  known  that  ideal  PSK  channels  can  be  frequency-multiplexed 
v;ithout  cross-talk  provided  that  the  freqn.ency  separation  between  channels  is 
an  integral  multiple  of  ens,  where  T  is  the  duration  of  an  elemental^- 

signal  interval.  If  there  exists  a  frequency  offset  between  transmitter  and 
receiver  then, not  only  is  the  response  to  the  cosired  signal  reduced,  but 
cross-talk  will  also  occur.  Appendix  I(o)  determines  the  error  probability  of  e. 
Binary  Coherent  Pulsed  Phase  Shift-Keyed  System  (hCPPSiCS)  when  cross-talk  is 
due  to  two  adjacent  channels  separated  by  cps,  and  tlic  receiver  is  offset 

in  frequency  by  A  f  cps,  The  rnmilt  is  reproduced  as  Figure  11-7. 

The  need  for  an  absolute  phase  reference  for  the  demodulation  of  CPSK 
signals  noses  a  serious  nractlcal  problem.  Two  approaches  to  the  solution 
of  this  problem  have  been  used,  (no  is  to  expend  a  finite  portion  of  the 
transmitted  pov/er  to  the  transmission  of  a  reference  signal,  which  may  be 
recovered  with  a  very  narrow  band  receiver,  in  practice,  such  a  receiver 
usually  takes  the  form  of  a  "phase-locked  loop",''’'i,e,,  a  phase  reference 
signal  is  locally  generated  by  an  oscillator,  the  nhase  of  which  is  controlled 
by  the  received  signal.  The  other  approach  is  to  encode  the  information  to  be 
transmitted  in  accordance  vrLth  iidPfiK  logic.  It  will  be  recalled  that  DCPSK 
logic  encodes  the  m  discrete  signals  as  m  discrete  phase  shifts  between 
successive  signals.  At  the  transmitter  an  absolute  phase  reference  may  be 
used  and  at  the  receiver  a  reference  oscillator  may  be  phase-locked  by  the 
received  signal  in  the  manner  described  below.  The  frequency  of  the  incoming 


I'he  cor;:  iUens  under  which  a  nulsed  d-”.::  system  can  be  operated  in 
the  nresence  cf  a  frequency  error  '..'crt'  discussed  on  iiaf.e  ?• 

Taber  I,  danders  I. 
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Figure  U-7  ERROR  PROBABILITY  OF  A  BCPPSKS  WITH  FREQUENCY  ERROR 


IF 


signal  is  multiplied  by  m  in  such  a  manner  that,  in  the  abspnce  of  noise,  a 
signal  of  constant  nhase  results  regardless  of  which  of  the  m  phases  the  input 
signal  assumes.  This  signal  is  then  passed  through  a  very  narrow  band  filter, 
which  again  may  take  the  form  of  a  phase-locked  loop,  and  the  reference  signal 
is  finally  obtained  by  a  phase-locked  frequency  divider.  Note  that  the  phase 
of  the  reference  signal  so  obtained  is  known  only  to  correspond  to  one  of  the 
n  possible  transmitted  phases.  However,  for  the  reception  of  DCPSK  signals, 
knowledge  of  absolute  phase  is  not  required. 

The  minimum  bandwidth  which  can  be  used  in  recovering  the  reference  signals 
with  either  of  the  above  systems  (i,e,,  the  system  where  soma  power  is  expended 
for  the  transmission  of  the  reference  signal  and  the  DCPSK  system)  is  determined 
by  the  stability  of  the  transmission  medium  and  equipments. 

The  operation  of  a  DCPDK  system  operating  in  the  manner  described  above 
has  not  yet  been  evaluated.  It  has  been  mentioned  primarily  to  point  out  that 
DCPSK  systems  are  not  restricted  to  the  use  of  the  nrevious  signal  as  a  phase 
reference.  It  is  also  noted  that  with  a  DCPSK  system  in  which  the  reference 
phase  is  derived  over  a  large  number  of  signal  intervals  one  would  expect  a 
marked  decrease  in  the  conditional  orobability  of  error  given  that  the  adjacent 
datum  is  in  error,  i.e.,  a  reduction  in  tho  tendency  for  errors  to  occur  in  pairs 
vrhich  one  expects  vhon  only  the  previous  1;--  used  as  a  phase  reference. 

The  results  of  analyses  of  ■..•'■.PPK  systems  which  derive  their  reference 
phase  from  only  the  previous  signal  interval  will  now  be  described. 

Previous  analysis'  derived  the  error  nrobabillty  of  various  binary 
communications  systems  operating  in  the  presence  of  additive  white  Gaussian 
noise,  and  noted  that  the  L.GP31'  system  required  exactly  l/2  the  signal  energy 
of  a  noncoherent  rrequency  Shift-Keyed  System  to  obtain  the  same  error  probability. 
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The  reasons  for  the  relationsliip  are  examined  in  Appendix . I (f).  It  is  concluded 
that  equation  If-lb  is  applicable  to  all  noncoherent  binary  systems  which  use 
orthogonal  (  /O-O)  sdrnals  having  onual  energy.  The  four  possible  waveforms 
produced  by  a  n;iC?.;>i:  system  dui'ing  two  signal  inteir/als  can  be  divided  into  tvfo 
sots  containing  tvro  nombors  each,  according  to  vrhether  or  not  there  is  a  phase 
change  betv/een  succeeding  r.imal  inteiTalc,  The  tv;o  sets  of  signals  satisfy 
the  conditions  for  apnl icability  of  ./-uation  If-lb,  Upon  noting  that  the  energy 
in  each  waveform  corresnonds  to  two  hits,  the  relationshin  of  Equation  If-la 
to  Equation,  If-lb  follows.  The  nerfox-mance  of  a  receiver,  called  a  Double-Bit 
, .atohed-r'’il*  r  Ifeceiver,  which  employs  two  filters,  one  matched  to  the  constant 
phase  and  the  other  to  the  nhace  reversal  set,  and  envelope  detectors  is 
examined,  comnared  with  and  found  to  Vio  equivalent  to  that  of  a  BDCPSK  receiver 
vrhicli  comnares  the  nhascs  of  t'-e  sirnals  received  during  adjacent  signal 
intervals , 

]n  '.p-^endix  " 'p)  the  cl.araoter  error  ’'>rob;ibi '' ity  of  m-ctate  1CF3K  systems 

operating  in  the  rresonce  of  v/i.ite  ^''aursian  noire  is  analyzed.  The  probability 

is  equal  to  the  probability  t!-,at  the  ri.nr'c  -'ifference  of  bv;o  vectors  of  equal 

magnitude  '..'hich  are  independently  nertuvbod  by  iaussian  noiso  differ  by  more 
77^/ 

than  /rr;  from  the  nhase  dirfei’ciice  of  their  ;rieans,  .\n  exiu’es.sion, 

.'quation  Ig-dl,  for  the  probability  density,  h  J  ,  of  this  phase  difference 

O'  '  1  n 

ic  The  beiiOTior  of  A(.i.)  ir;  (liovrn  in  :M.{5ure  II-c's  This  expression  C4 

v;ar'-  integrate!,  1.7/  r-.-a-p ; ri^  eon">jt'i '..ion,  to  yield  the  character  error  proba¬ 
bility  i  )  .  -  Li-we  b.i-0!  rOiOi-;.':  the  re:  a;*  tr;  of  bhi.s  computation,  '.’or 
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Figure  11-8  PROBABILITY  DENSITY  OF  PHASE  DIFFERENCE 
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PROBABILITY  OF  CHARACTER  ERROR 


the  case  m  =  2  it  is  possible  to  perform  the  integration  in  closed  form  yielding 
Equation  Ig-5U,  the  error  probability  of  a  BDCPSK  in  agreement  with  earlier 
analysis 

A  sinqjle  approocimate  formula.  Equation  Ig-80,  was  obtained  from  >Aiich 
extensive  tabulations  of  /^(m)  were  prepared.  Cross-checks  against  the  more 
limited  tabulation  of  obtained  from  the  exact  formulation  shews  excellent 

agreement  in  all  cases  in  which  E/N^>c><5//6,  Tabulations  permitting  the  determi¬ 
nation  of  the  error  probability  for  cases  not  Illustrated  in  the  figure  are 
included  in  Appendix  1(g). 

It  is  possible  to  generate  U-state  DCPSK  signals  by  coTrtblnlng  two  2-state 
(BDCPSK)  signals  in  quadrature.  The  error  probability  of  these  sub¬ 

channels  has  been  computed  from  Equation  Ig-lli^  and  plotted*  Since 


I8-Ili6 


and  was  computed  by  a  different  approach  from  that  used  for  the 

conpitatlon  of  P_(li)  (which  is  obtained  from  hfotj  ),  Equation  Ig-lli6  serves 
c 

as  an  excellent  check  on  the  computation  of  P_(m)  as  can  be  seen  from  Figure  II- 10, 

c 

The  computation  of  Pgyj)(^)  yielded  as  an  intermediate  result  a  tractable  integral 
expression,  Equation  Ig-137,  for  the  probability  that  the  dot  product  of  arbitrary 
two-dimensional  vectors  perturbed  by  independent  samples  of  a  two-dimensional 
Gaussian  process  is  negative  (i.e.,  that  the  phase  difference  between  these 
vectors  exceed  in  absolute  value).  This  result  may  be  of  interest 

in  areas  not  related  to  the  present  effort)  it  may  also  be  specialized  to 
identical  vectors,  perturbed  by  independent  Gaussian  noise,  yielding  the  error 
probability  of  a  binary  DCPSK,  Equation  lg-lii2,  in  agreement  with  previous 
analyses . 


-!'<•  Decker  I 
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Figure  II- 10  SUB-CHANNEL  ERROR  PROBABILITY  IN  AN  TPf  ~  ^  DCPSKS 
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Annendix  1(h)  determines  the  error  probability  of  m-state  DCPGK  systems 
operating  with  a  frociucncy  "offset",  i.e,,  a  difference  in  the  frequency  of 
the  received  signal  and  the  design  frequency  of  the  receiver,  3uoh  frequency 
errors  may,  in  this  case,  be  due  to  numerous  causes  such  as  Doppler  shift,  and 
frequencj’-  differences  In  heterodyning  oscillators.  Although  it  is  impossible 
to  make  a  universally  applicable  estimate  of  the  magnitude  of  the  frequency 
error  likely  to  be  encountered  in  practice,  it  may  be  well  to  bear  in  mind  that 
a  communications  system  which  is  desigied  to  yield  toll  quality  telephone  service 
cannot  tolerate  a  shift  of  more  than  a  very  small  number  of  cps. 

The  results  of  this  analysis  are  presented  graphically  in  Figure  II-ll 
(a  more  extensive  tabulation  is  contained  in  Appendix  1(b)),  The  parameter 
oi.=  —  =  A'f  T  of  that  figure  is  seen  to  correspond  to  the  number  of  cycles 
gained  or  lost  during  one  signal  interval  due  to  the  frequency  offaeti  In  an 
m-state  system  the  phase  difference  must  be  determined  to  within  radians 

or  cycles.  It  will  be  noted  that  for  oc  >  error  probability 

annroaches  unity  for  sufficiently  large.  This  merely  reflects  the  fact 
that  the  phase  error,  as  measured  by  the  number  of  cycles  gained  (or  lost)  per 
signal  interval  in  the  absence  of  noise  exceeds  the  decision  threshold. 
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ERROR  PROBABILITY  OF  m-STATE  DCPSKS  WITH  FREQUENCY  ERROR 


III. 


ANALYSIS  OF  DIFFERENTIALLY  COHERENT  PHASE  SHIFT  KEYED  (DCPSK)  DIGITAL 
DATA  SYSTEMS  OPERATING  OVER  A  FADING  FM  TROPOSPHERIC  SCATTER  CIRCUIT 


Analysis  of  a  typical  tropospheric  scatter  link  using  the  parameters 
or  the  AN/GSC-h"  shows  that  all  but  a  negligible  fraction  of  the  errors  occur 
■when  the  received  carrier-to-noise  power  ratio  fades  well  below  the  FM  improve¬ 
ment  threshold.  It  is,  therefore,  of  utmost  importance  to  prevent  deep  fadesj 
diversity  reception  is  the  primary  means  of  achie'ving  this.  The  effec'ti'veness 
of  various  orders  of  diversity  in  improving  the  system's  performance  is  examined 
and  the  results  are  shown  in  Table  II  of  Appendix  11(a).  For  an  optimum  coherent 
diversity’*^  combiner,  one  finds  that  the  ratio  of  the  probability  density  of  the 
signal-to-noise  ratio  obtained  without  diversity  to  that  obtained  with  m-fold 
diversity  is  given  by 
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where:  W  is  the  signal-to-noi.e  ratio  at  the  output  of  the  combiner, 

is  the  mean  signal-tc-noise  ratio. at  the  input  to  the  combiner. 

In  the  above  equation  all  inputs  are  assumed  to  have  independent  Rayleigh 
fading  statistics  vdth  equal  means  and,  from,  this  equation,  it  is  seen  that 
optimiom  diversity  combination  results  in  a  decreased  probability  of  when¬ 
ever  0  ij  and  vice  versa.  * 

The  circuit  analyzed  is  assumed  to  be  channelized  in  accordance  with 
conventional  frequency  division  multiplex  practice.  Thus,  each  data  link  is 
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asE.'.f;ned  to  one  c.f  77  voice  channels,  each  Ii  kc’s  wide.  It  will  be  noted  that 
t'ne  six  tones  require  only  6  x  300  “  1800  cps,  thus  a  sii^eable  fraction  of  the 
available  bandwidth  is  taken  up  by  guard  bands.  Channelization  on  the  basis  of 
voice  channels,  which  is  reasonable  under  certain  circumstances,  nay  not  be  de¬ 
sirable  under  other  circumstances. 

The  FM  link  is  assumed  to  employ  pre-emphasis  in  accordance  with  accepted 
procedures,  the  aim  of  which  is  to  achieve  equivalent  intelligibility  of  voice 
transmission  over  all  channels.  It  may  reasonably  be  assumed  that  the  quality 
of  voice  signals  is  subjectively  judged  primarily  on  the  signal -to-noise  ratio 
attained  during  the  large  fraction  of  time  that  the  system  operates  above  the 
FM  improvement  threshold.  During  this  time,  the  noise  power  density  at  the  out¬ 
put  of  the  FM  system  is  proportional  to  the  square  of  frequency,  and  signal  pre- 
emphasis  Is  employed  to  compensate  for  this.  The  quality  of  a  data  link  may  be 
judged  primarily  on  the  basis  of  its  error  probability.  As  almost  all  errors 
occur  during  the  small  fraction  of  time  during  which  the  system  operates  below 
the  FM  improvement  threshold,  a  pure  data  system  should  be  equalized  on  that 
basis  (assuming  all  data  to  be  equally  important).  Well  below  threshold,  the 
noise-power  density  is  found  to  be  independent  of  frequency  and  pre-emphasis 
should,  therefore,  be  avoided.  If  a  system  is  used  for  the  transmission  of  both 
data  and  voice,  then  a  compromise  based  on  the  relative  importance  of  the  two 
modulations  must  be  reached.  If  one  system  carries  both  data  and  voice  and  if 
pre -emphasis  is  used,  then  the  data  should  be  assigned  to  the  highest  frequency 
channels  since  this  will  result  in  the  lowest  error  rate  and  since,  in  view  of 
the  pre-emphasis,  it  does  not  matter  which  charnels  are  used  for  the  trans¬ 
mission  of  voice.  If  pre-emphasis  is  not  used,  then  the  performance  of  the  data 
link  is  independent  of  which  channels  are  used  for  this  purpose,  but  the  lower 
frequency  channels  will  give  improved  performance  when  used  for  the  transmission 
of  voice.  Therefore,  it  is  seen  that,  regardless  of  the  degree  of  pare -emphasis, 
data  should  always  be  sent  over  the  high-frequency  channels  and  voice  over  the 
lov;er  frequency  channels.  It  is  to  be  noted  that,  in  a  frequency  division  multi¬ 
plex  system,  the  function  of  the  usual  pre-emphasis  circuit  can  be  obtained,  ap¬ 
proximately,  by  adjustment  of  the  signal  levels  in  the  various  channels.  The 
availability  of  independent  adjustments  offers  a  great  deal  of  operational 


flexibility.  Thus,  one  may  increase  the  deviation  assigned  to  a  channel  curry¬ 
ing  "more  important"  data  at  the  expense  of  the  other  channels.  Again,  when 
the  tropospheric  conditions  are  unfavorable,  it  may  be  possible  by  removing 
some  of  the  channels  and  increasing  the  deviation  of  the  remaining  channels  to 
retain  acceptable  error  probabilities. 
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IV 


COMMENTS  ON  AN  ARTICLE  ENTITLED  "IDEAL  BINAHlf  PULSE  TRANSMISSION 
BY  AM  AND  FM" 


It  can  be  shown  by  very  £;eneral  arguments  that  a  binary  communications 
system  operating  with  a  .given  average  signal  energy  can  attain  the  lowest  possible 
error  probability  in  the  presence  of  i^hite  additive  Gaussian  noise  only  if  the 
two  .signals  are  the  negative  of  each  other.  Appendix  1(c)  discusses  the  major 
points  needed  for  proof  of  the  above  statementj  a  detailed  proof  will  be  found  in 
a  previous  Cornell  Aeronautical  Laboratory  Report.  It  is  to  be  noted  that  the 
precise  form  of  the  signals  was  not  specified  and  that  binaiy-  PSK  signals  meet 
the  criterion.  Therefore,  under  the  assumed  conditions,  no  binary  data  trans¬ 
mission  system  can  attain  a  lower  error  probability  than  a  binary  PSK  system 
used  ■'/dth  an  optimum  (maximum  likelihood  or  coherent  matched  filter)  receiver. 

The  November  1959  issue  of  the  Bell  System  Technical  Journal  contains  an 
article  entitled  "Ideal  Binary  Pulse. Transmission  by  AM  and  FTl"  by  E.  D.  Sunde 
of  the  Bell  Telephone  Laboratory  (BTL).^''*  This  paper  contains  a  very  detailed 
•and  extensive  investigation  into  the  problems  associated  with  the  transmission 
of  binaig/  data  by  means  of  amplitude  or  frequency  modulation  of  a  carrier.  In 
this  paper,  Sxuidc  concludes  that  an  FM  sj-'stem  vrLth  optimum  pre-  and  post-detection 
filtering,  co\.j.d  be  superior  to  the  binary  PSK  system  vdth  an  optimum  receiver 
and  could,  in  particular,  attain  a  lower  error  probability.  This  conclusion  is 
e'/idently  incompatiblo  vrith  accepted  theoryj  therefore,  Sunde' s  paper  was  closely 
examined  for  posclblc  errors  and  the  results  of  our  examination  were  discussed 
wi  th  Mr.  Sunde  during  a  \'lsit  to  the  Bell  Telephone  Laboratories.  A,5  a  result 
of  this  discussion,  Mr.  Sunde  agreed  that  our  previous  conclusions  remain  unimpaired. 

The  difference  between  Sunde 's  and  our  previous  results  arises,  not  from 
errors  in  the  foimal  mathematics  used  to  derive  these  results,  but  from  two 
premises  used  by  “'■unde  vjhich,  it  was  agreed, .are  not  tenable. 
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The  first  of  these  concerns  the  comparison  of  Jicital  data  ti'ansmissicn 
systems  on  the  basis  of  sicnal-to-noise  ratios.  The  follovTing  paragraph  appears 
on  page  lli09  of  the  referenced  article:  "Comparison  of  binary  PM  and  AM  on  the 
basis  of  signal-to-nolse  ratios  is  legitimate  provided  that,  for  a  given 
the  error  probability  is  the  same  in  JM  and  AM.  For  high  signal-to-noise  ratios, 
this  is  approximately  the  case,  since  the  normal  law  (171)  is  then  closely 

9 

approximated  in  FM  ,  On  this  premise,  comparison  on  the  basis  of  signal-to-noise 

ratios  is  legitimate  for  small  error  probabilities."  However,  the  premise 

cannot  be  defended  since  it  has  not  been  shorn  that  a  given  N  /S'  results  in  the 

0  0 

same  error  probabilities  for  F!f  and  AM.  A  close  approximation  to  the  normal 
law  is  not  sufficient  to  assure  this.  In  order  to  obtain  identical  error  proba¬ 
bilities  at  large  signal-to-noise  ratios,  the  tails  of  ttie  probability  density 
function  rm.ist  be  Identical  with  those  of  a  normal  distribution.  Small  deviations 
in  the  tails  of  the  probability  density  function  can  lead  to  orders  of  magnitude 
of  difference  in  the  error  probability,  as  can  be  easily  demonstrated.  This 
behavior  can  be  explained  in  a  somev/hat  diff«?rcnt  manner  as  follows:  the 
probability  of  error,  Pgyj,Qj,j  nay  be  expressed  as  the  difference  between  unity 
and  the  probability  of  being  correct. 


error 


=  1  -  P 


correct 


If  two  distributions  are  nearly  identical,  then  the  two  resulting  values  of 
^correct  nearly  identical  for  large  in  fact,  they  iri.ll  both 

approach  unity.  The  ratio  of  the  differences  between  the  tv;o  values  of  P 
and  unity  may,  however,  be  very  large  (or  very  small). 


correct 


Tne  second  premise  concerns  the  manner  in  which  the  signal-to-noise  ratio 
in  an  FM  system  is  computed.  Equation  (209)  of  Sunde’s  paper  gives  the  output 
voltage  of  the  FTi  system  due  to  a  single  interfering  sinusoid,  relative  to  the 
output  due  to  the  desired  signal  at  the  sampling  points.  Equation  (212)  is  an 
approximation  to  (209)  vdiich  is  valid,  provided  the  amplitude  and  rate  of  change 
of  the  interfering  signal  arc  small  compared  to  the  desired  signal.  Equation 


oundl: 


Ref ere ncc 


co: 


‘  3jiOri(5r! 


ir. 


28 


C???)  or  (116)  niws  the  rrr.o  '  of  (212)  for  a  uniform  distribution  of  the 

;'!'aso  o'”  tlie  interforinf,  sifnal,  'nio  cxnresai.ons,  Equations  (118)  and  (119),  for 
the  noise  power-tc  sicnal  power  ratios  at  the  O'ltput  of  an  Fll  system  operating 
in  the  presence  of  white  Gaussian  noise  are  obtained  formally  by  integrating 
liquation  (225)  on  (116)  over  all  frequencies.  However,  in  order  to  justify  this 
step,  one  must  prove  that  the  approximations  made  in  going  from  Equation  (209) 
to  Equation  ( 112)  are  still  valid  in  this  case.  Gaussian  noise  of  nonzero  power, 
no  natter  hew  small,  will  violate  these  assumptions  with  nonzero  probability# 

',7!'on  these  assumptions  are  violated,  a  noise  peak  which  is  very  large  compared 
to  tl'.e  noise  at  other  tines  can  be  generated.  It  is  conventional,  in  connection 
•i‘'  ri'  systems,  to  speak  of  the  noise  capturing  the  phase  of  the  Waveform  under 
‘'oso  ci  rcinstnr.ces.  Because  of  square  law  weighting,  the  contribution  of  these 
largo  peaks  to  th.c  mean  square  output  noise  is  accentuated.  If  the  contribution 
t)'.o  noise  neqks  is  neglected,  an  optimistic  result  will  be  obtained. 

The  assumption  of  the  signal  retaining  control  of  the  carrier  phase  at 
all  times  is  consistently  made  throughout  the  paper,  e.g.,  in  computing  the 
effects  of  a  post-dotection  filter.  Again,  it  can  be  easily  demonstrated  that 
changes  of  orders  of  magnitude  in  the  computed  error  probability  can  resxilt 
when  socond-ordcr  terns  are  neglected. 

After  discussing  the  above,  Hr,  Sunde  readily  agreed  that  the  lowest 
error  probability  attainable  with  F--'  in  v;hite  Gaussian  noise  must  be  greater 
than  that  attainable  wi.th  coherent  P5K.  Has  leaves  the  question  of  determination 
of  the  error  probability  of  the  optimum  binary  FT1  system  open  to  further  investi- 
ation  vrhich  should  be  greatly  aided  by  Sunde 's  vrork,'^ 


.r 

Ti  e  oxj'ression  for  the  error  probaVdlity  of  noncoherent  L’SK  given  in  th.e 
rercroucod  C.A.L.  report,  ibid,  is  applicable  to  wide  deviation  FSK. 
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PilOPR:iTIK.;  OF  HOIolC  AMID  THli:  EFFECT  OF  H-IPULSE  NOISE 

Gi:  PIGITAL  DATA  CQI-SIWIICATIOI.'S  UEI!iG  CLOSE-PACKED  CODES 

The  presence  of  impulse  noise  is  a  major,  and  sometimes  the  primary, 

source  of  errors  on  some  types  of  oomniunioations  systems.  The  results  of  a 

brief  literature  search  for  information  pertaining  to  impulse  noise  are 
reported  in  Appendix  III (a).  Impulse  noise  may  have  a  wide  variety  of  origins 
such  as  ignition  noise,  lightning  discharges,  static  originating  within  the 
atmosphere  and  of  extraterrestrial  origin.  The  initial  impulses  which  them-, 
selves  may  have  random,  nonuniform  and  nonstationary  distribution  in  strength, 
time  and  space  are  modified  by  the  characteristics  of  the  medium  prior  to 
recentlon.  It  is  not  surprising,  therefore,  that  efforts  to  describe  Impulse 
noise  and  to  treat  its  effects  analytically  have  had  only  very  limited  success. 

In  order  to  obtain  any  results  it  is  usually  necessary  to  make  assumptions 

which  greatly  restrict  the  applicability  of  the  results  obtained.  This  situation 
is,  for  instance,  encountered  in  Appendix  IV (c). 

The  form  of  l?npulse  noise  most  adequately  treated  in  the  literature  is 
Poisson  Noise,  which  results  from  the  linear  superposition  of  the  effects  of 
elementary  impulses  which  occur  in  a  particular  random  fashion  in  time,^  Assuming 
the  wave  forms  produced  at  the  receiver  by  the  elementary  impulses  to  be 
identical,  it  is  possible  to  obtain  an  analytical  representation  of  the  first 
order  statistics  of  Poisson  noise."'  The  oharaoterlstics  and  the  mathematical 
tractability  of  Poisson  noise  depend  to  a  great  extent  upon  the  average  density 
of  the  elementary  pulses.  At  low  pulse  densities  vihen  there  is  little  over¬ 
lapping,  there  will  be  appreciable  gaps  between  pulses.  Consequently,  zero 
amplitude  is  probable  and  amplitudes  exceeding  those  of  the  elementary  pulses 
are  verj"  improbable.  On  the  other  hand,  as  the  average  pulse  density  becomes 
very  large,  the  precise  form  of  the  individual  pulses  becomes  unimportant, 
the  strength  of  the  delta  function  at  the  origin  goes  to  zero,  and  the  Poisson 
noise  goes  over  into  Gaussian  noise.  Figure  V-1  illustrates  these  effects  for 
rectangular  pulses,  the  amnlitude  of  which  are  Oaussianly  distributed. 
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Sections  (b)  and  (c)  of  Appendix  III  determine  the  error  probability  of 
digital  communications  systems  using  close-packed  codes  when  perturbed  by  impulse 
noise,"  The  model  of  impulse  noise  used  in  Appendix  lll(b)  is  that  proposed  by- 
according  to  which. 

Letter  errors  due  to  impulse  noise  occur  in  bursts.  Within 
the  time  interval  occupied  by  a  burst,  the  probability  of 
error  occurrence  is  given  by  the  Poisson  approximation  to 
the  binomial  (Bernoulli)  distribution.  Outside  of  this 
interval,  the  probability  of  error  occurrence  is  zero. 

Bursts  of  duration,  S  ,  occur  at  randomi  the  probability  of 
burst  occurrence  in  a  given  time  interval  being  given  by  a 
Poisson  approximation  to  the  binomial  distribution. 

The  probability  of  overlapping  bursts  is  assumed  negligible. 

In  Appendix  III(c)  assumptions  1  and  2  above  were  modified  as  follows. 
Letter  errors  vdthin  a  burst  are  assumed  to  have  a  binomial  rather  than  a 
Poisson  distribution.  The  reason  for  this  modification  is  that  the  Poisson 
distribution  permits  an  unlimited  number  of  errors  to  occrir  during  a  finite 
interval  while,  at  most,  all  the  letters  of  a  word  can  be  in  error.  The 
duration  of  bursts  was  assumed  to  be  uniformly  distributed  over  a  finite  range. 
This  was  felt  to  be  a  more  realistic  than  the  assumption  of  constant  burst 
length. 

Figure  V-2  is  a  plot  of  error  probability  vs,  expected  number  of  letter 
errors  pel  word  (assuming  the  word  to  be  completely  covered  by  a  burst),  for 
various  burst  rates,  using  the  original  assumptions. 

Figure  V-3  is  a  similar  plot  which  permits  comparison  of  -the  error 
probabilities  using  the  original  and  the  modified  assumptions.  (Note  that 
the  average  biurst  length  is  the  same  in  both  cases.)  It  is  seen  that  over  the 
range  of  variables  plotted  the  -two  sets  of  assumptions  lead  to  comparable 
error  probabilities. 


P.  Hertz, 
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"Close-packed  codes  are  defined  in  Appendix  Ill(b), 
"-"•Hertz  I 
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PROBABILIIY  density  of  "kb'CTANGULAR"  POISSON  NOISE 


f>  (PROBABILITY  OF  WORD  ERROR) 
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PKOBABILITY  OF  MORD  ERROR  (Ptei) 


VI 


"MOMENT  DETECTION" 


Ihe  "Moment  Detection"  technique  was  originated  at  Rutgers  University 
as  part  of  the  work  performed  under  Contract  DA-36-039-8c-l531ii  with  the 
Signal  Corps  of  the  U.  S*  Amy.  In  one  of  the  references*  to  this  Mork| 

the  conception  of  "moment  detection"  is  described  thus*  " . the  entire 

idea  of  a  moment  detector  had  its  origin  in  the  representation  of  pulses  by 
a  Oram-Charller  series."  The  work  at  Rutgers  on  "moment  detection"  represents, 
to  a  considerable  extent,  an  ad  hoc  effort  to  utilize  the  Gram- Charlie r  series 
representation.  In  the  Qrara-Charlier  representation  of  a  waveform  v(t)  ^ 
the  coefficients  of  the  terns  in  the  series  are  deteznined  by  the  temporal 
moments,  =  J*  V‘{t)  dt  of  the  waveform  .  The  Qram-Charlier 

series  is  only  one  of  many  possibly  series  representations  which,  under  various 
restrictions  ,  converge  to  the  functions  vhioh  they  represent.  It  is  to  be 
noted  that  "moment  detection"  was  not  conceived  on  the  basis  of  satisfying 
some  desirable  criterion,  e.g.,  a  maximum  likelihood  receiver,  or  a  receiver 
vdiich  minimizes  the  mean  square  error  of  its  output. 


Appendix  IV  reports  in  detail  on  the  analytical  and  experimental 
investigations  performed  on  "moment  detection"  under  the  current  contract. 
Appendix  IV(a)  considers  "Moment  Detection  in  the  Presence  of  VIhite  Gaussian 
Noise".  It  is  shown  that  a  linear  filter  having  impulse  response 


has  an  output  equal  to  the  order  moment  of  the  input  at  time  t  • 

If  the  input  signal  has  the  form  v(t)  ~  ^  decisions 

based  on  the  order  moment  are  equivalent  to  matched  filter  reception. 


Slade  I 

The  functions  "of  interest  in  praotlce"  seemingly  always  fulfill  these 
restriotiona  (primarily  because  they  are  of  finite  peak  power,  of  finite 
duration  and  of  finite  bandwidth). 
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Reception  of  two  pulse  groups  based  on  use  of  the  and  order 

moments  are  examined.  It  is  shown  that  the  effect  of  noise  on  the  observed 
moments  results  in  dependent  deviatiors  from  the  expected  values.  The  optimum 
decision  rules,  i.e.,  those  decision  rules  •vdiich  will  lead  to  the  lowest 
possible  error  probability,  are  derived.  While  the  optimum  decision  boundaries 
are  known,  it  was  not  possible  to  derive  a  closed  form  expression  for  the 
resulting  error  probability}  however,  closed  form  expressions  for  rather 
tight  upper  and  lower  bounds  to  this  probability  are  obtained.  The  effects 
of  a  simple  low  pass  filter  preceding  the  "moment  detection"  circuit  and  of 
overlapping  of  data  pulses  is  examined.  ' 

Appendix  IV(b),  "Optimum  Decision  Based  on  Multiple  Moment  Detection", 
demonstrates  how  the  optimum  decision  based  on  an  arbitrary  choice  of  moments 
is  derived.  Briefly,  this  involves  a  linear  transformation  to  a  space  in 
which  the  noise  which  perturbs  the  moments  has  a  'n'  dimensional  normal 
spherical  distribution.  In  this  space,  maximum  likelihood  decisions  can, 
i  i  principle,  be  readily  perfomed.  Thus,  if  all  words  are  a  priori,  equally 
probable,  the  decision  is  in  favor  of  that  word  whose  expected  coordinates 
are  closest  to  the  observed  coordinates  in  this  orthonormalized  space. 

Appendix  IVCc),  "Analysis  of  the  Efiect  of  Impulse  Noise  on  Moment 
Detection",  presents  the  results  of  an  attempt  to  deal  with  the  above  topic 
analytically.  It  was  clear  at  the  outset  that  one  could  not  expect  to  obtain 
results  of  completely  general  applicability.  It  was,  therefore,  assumed  that 
the  distribution  of  impulse  strength  has  a  symmetric  hyperbolic  distribution, 
as  suggested  by  P,  Mertz*,  and  that  the  distribution  of  the  spacing  X  of 
in^julses  was  uniform  over  the  range  /Ij  ^  ^  •  The  impulses  were  assumed 

to  be  true  delta  functions  but  these,  as  well  as  the  data  pulses,  were  passed 
through  a  simple  low  pass  filter  prior  to  the  "moment  detection"  circuit.  In 
order  to  de’^.ve  numerical  results,  further  restrictive  assumptions  had  to  be 
introduced. 


Appendix  IV(d)  describes  the  “Experimental  Investigation  of  Moment 
Detection",  This  appendix  gives  a  detailed  description  of  the  equipment  which 
was  developed  and/or  assembled  and  of  the  methods  used  in  this  task.  It  also 
includes  a  description  of  sources  of  errors  and  the  shortcomings  encountered. 


The  fairly  extensive  analytical  and  experimental  investigations  of 
"moment  detection",  reported  in  detail  in  Appendix  IV,  showed  that  this  tech¬ 
nique  has  serious  difficulties  of  both  a  theoretical  and  practical  nature. 

As  a  result,  it  Is  felt  that  "moment  detection"  does  not,  in  theory,  show 
advantages  over  other  decision  techniques  under  any  of  the  circumstances 
considered  and  that  the  implementation  of  this  technique  poses  excessive 
equipment  requirements. 


Having  amassed  sufficient  evidence  to  draw  the  above  conclusion,  and 
in  view  of  the  basis  on  which  "moment  detection"  was  originally  proposed.  It 
did  not  appear  warranted  to  attempt  to  investigate  all  of  the  characteristics 
of  this  technique.  The  major  points  bearing  on  the  usefulness  of  "moment 
detection",  or  lack  thereof,  are  described  below, 

(1)  The  dependence  of  the  probability  of  error  cn  the  particular 
moments  and  the  number  of  moments  utilized  in  the  decision  remains  unknown. 

It  should  be  noted  that  it  is  not  generally  time  that  the  error  probability, 
computed  on  the  assur^tlon  of  optimum  decision  rules,  decreases  as  more  moments 
are  used  in  arriving  at  a  decision  (although  it  is  clear  that  the  error  proba¬ 
bility  cannot  increase  If  additional  moments  are  used  to  best  advantage). 


(2)  It  is  easily  demonstrated  that  any  decisions  based  on  "moment 
detection"  processes  can  also  be  obtained  through  the  use  of  linear  filters. 
It  is  not,  in  general,  possible  to  roplace  even  veiy  simple  linear  filters 
(viz,,  a  simple  bandpass  filter)  by  decisions  based  on  "moment  detection". 
For  instance,  "moment  detection"  can  be  equivalent  to  matched  filtering  only 
if  the  signal  has  the  form 


irit)  = 


J  ti  04  t  47" 
[  0, 
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(3)  The  weighting  functions  used  in  "moment  detection",  viz.,  , 

have  low-<pas8  spectra,  ^ile  moat  of  the  signals  used  in  modem  communication 
systems  have  bandpass  spectra.  Because  of  this  spectral  mismatch,  it  is  virtually 
impossible  to  use  '•moment  detection"  with  bandpass  signals.  For  this  reason,  the 
"moment  detection"  technique  was  applied  to  the  detected  output  of  the  FSK  eq:ulp- 
ment  during  the  experimental  evaluation  of  this  technique*  (It  is  felt  that  it 
would  be  preferable  to  call  the  technique  "moiraent  decision"  rather  than  "moment 
detection".) 

(li)  From  a  practical  point  of  view,  the  equipment  needed  to  implement 
"moment  detection"  is  Inordinately  ooiiq>lloated,  as  can  be  appreoiated  from  the 
following  considerations. 

The  oonpitation  of  the  moments  can  be  performed,  in  principle,  by 
multiplying  the  waveform  vit)  by  using  a  hl^  speed  precision  analog 

multiplier  and  integration  of  the  product  thus  obtained*  As  no  multiplier 
having  acceptable  characteristics  was  available,  the  moments  were  computed 
by  means  of  the  "multiple  definite  integral  method"*  With  this  method,  -k+l 
integrations  are  performed  in  order  to  determine  the  ^  moment.  The 
required  moments  are  then  obtained  as  the  weighted  sum  and  difference  of 
these  integrals*  Since  the  resulting  moment  may  be  of  much  snaller  magnitude 
than  the  various  Inputs  of  which  It  is  ccnQ>osed,  It  is  eoctremely  sensitive  to 
gain  variations  and  drift  of  the  equipment  used  (i*e,,  the  small  difference  of 
two  large  numbers  is  very  sensitive  to  small  fractional  changes  of  the  large 
numbers)* 

The  best  decision  rules*  (i»e.,  those  yielding  the  lowest  proba-  . 
bill ties  of  error)  are  too  Involved  to  be  implemented  with  practical  equipment* 

For  this  reason,  the  moments  were  computed  in  real  time  and  transferred  to 
magnetic  tape  for  later  analysis  by  a  large  digital  conputer.  The  computation 
of  the  theoretical  error  probability  >rtiich  results  if  the  optimum  decision 
rules  are  used  has  proven  untractablej  even  for  the  simple  oases  considered 
in  Appendix  IV,  closed  form  expressions  could  not  be  obtained* 


« 


These  rules  have  been  fonmilated  only  for  the  case  of  additive  white 
Gaussian  noise. 


(5^  Because  "moment  detection"  requires  that  decisions  be  based  on 
absolute  levels  (as  is  also  the  case,  for  Instance,  with  conventional  0N~0FF 
keying)  rather  than  on  relative  levels  (as  is  the  case,,  for  instance,  with 
conventional  matched  filter  reception  of  FSK  signals),  this  system  is  sensitive 
to  gain  variations.  When  "moment  detection"  is  applied  to  code  words  extending 
over  several  pulse  intervals,  the  decision  boundaries  are  closely  spaced  and, 
consequently,  the  sensitivity  to  gain  variations  becomes  very  great.  Under 
these  conditions,  the  system  also  becomes  very'  sensitive  to  small  DC  components 
such  as  may  be  generated  by  nonlinearities  in  the  associated  communications 
equipment.  (A  DC  component  due  to  noise  was  encountered  in  the  experimental 
investigation  of  "moment  detection".  See  Appendix  IV(d).)  The  great  sensi¬ 
tivity  to  DC  la  due  to  the  DC  being  effective  over  the  entire  word  duration 
and  the  t  ^  weighting  vAiile  the  decision  boundaries  must  be  determined  by 
the  change  in  moments  due  to  the  presence  or  absence  of  a  single,  and  in 
particular  the  first,  pvilse. 

(6)  In  the  experimental  evaluation,  the  use  of  "moment  detection" 
operating  on  the  output  of  the  PSK  discriminator  resulted  in  a  much  greater 
error  probability  than  that  obtained  with  a  linear  filter  followed  by  a  thres¬ 
holding  circuit. 


39 


BIBLIOGRAPHY 


Abramson, 

I  - 


Banerji,  1 
I  - 

Backer,  H 

I  - 


Bickel,  H 
I  - 


Brennan, 
I  - 


Brilliant 

I  - 

Cahn,  C.  1 

I  - 


II  - 


N.  M.: 

A  Class  of  Systematic  Codes  for  Nonindependent  Errors  IRE  Trans, 
on  Info.  Theory  Vol.  IT-5,  1959,  pp.  150-157. 


t.  B.: 

A  Systematic  Method  for  the  Construction  of  Error-correcting  Group 
Codes  May  21,  I960  p.  827- 

0.  and  Lawton,  J.  G.: 

Theoretical  Comparison  of  Binary  Data  Transmission  Systems  Cornell 
Aeronautical  Laboratory  Report  No.  CA-1172-S-1  Contract  AF-30(602)- 
1702  May  1958  RADC-TR-58-91  May  1958  AD-ll*8803. 


The  Coherent  Memory  Filter  Proceedings  Foiurth  Annual  Radar  Sym¬ 
posium  Februaiy  I4-6,  1958. 

).  G.  s 

Linear  Diversity  Combining  Techniques  Rroc.  IRE  Vol.  U7 
June  1959,  pp.  1075-1102. 


M.: 

Fading  Loss  in  Diversity  Systems  Convention  Riecord  Fifth  National 
Communications  Symposium  October  1959. 


Performance  of  Digital  Phase  Modulation  Communication  Systems 
IRE  Transactions  on  Communications  Systems  Vol.  CS-7,  No.  1 
May  1959. 

Comparison  of  Coherent  and  Phase-Comparison  Detection  of  a  Four- 
Phase  Digital  Signal  Correspondence  Section  Proceedings  of  the 
IRS  Vol.  h7,  No.  9  September  1959. 


JiO 


Cnlabi,  L.  and  Haefeli,  H.: 

I  -  A  Class  of  Binary  fvstematic  Codes  Correctinn  Errors  Occurrinc  at 

Random  and  In  Bu’  os  Transactions  of  the  International  Symposium 

on  Circuit  and  liiformation  Theory  Los  Angeles,  CaD.ifomia  June  16-18 
1959  pp.  79-9)i  IRE  Transactions  on  Information  Theory  Vol.  IT-5 
Special  Supplement  May  1959 • 

Campbell,  G. ; 

I  -  Use  of  an  Adaptive  Servo  to  Obtain  Optimum  Airplane  Responses 
Cornell  Aeronautical  Laboratory  Report  No,  81u 

CI.abaugh,  R,  G. : 

T  -  Estimated  AN/GSC-1i  Characteristics  on  Truro  Tropo  Circuit  Informal  memo 
Collins  Radio  Company,  Western  Division  A  27  December  1959 

Collins  Engineering s 

I  -  Report  No,  CER-W592  Performance  of  Predicted  Wave  ^sterns  in  the 
Presence  of  Additive,  White,  Gaussian  Noise  29  January  1958» 

Costas,  J, : 

I  -  Phase-shift  Radio  Teletype  Proceedings  of  the  IRE  li5  No.  1,  pp.  16-20 
Janaary  1957  • 

Davenport,  W.  13,  Jr,  and  Root,  V/.  L. ! 

I  -  An  Introduction  to  the  Tlieory  of  Random  Signals  and  Noise  McGraw-Hill 
1958. 

Drielz,  M,  and  Heald,  E. : 

I  -  A  Predicted  Wave  Radio  Telotyjic  Gy:;l,L'm  Collins  Radio  Company  Convention 
Record  IRE  National  Convention  Pt.  8  pp.  63-67  1951i. 

Enticknap,  R.  and  Schuster,  E. ; 

I  -  Sage  Data  System  Considerations,  Communications  and  Electronics  No.  IjO 
pp.  82)1-832  January  1959. 


Ill 


Feinstein,  A.: 

I  -  Foundations  of  Information  Theory  McQraw-Hill  Book  Company  New  York 

1958. 

F].eck,  J,  T.  and  Trabka,  E,  A.s 

I  -  Error  Probabilities  of  Multiple-State  Differentially  Coherent  Phase-Shift 
Keyed  Systems  in  the  Presence  of  White,  Gaussian  Noise  DETECT  MEMO  NO.  2 
Cornell  Aeronautical  Laboratorj^  2h  June  19^>0, 

Gilbert,  E.  N.: 

I  -  A  Comparison  of  Signalling  Alphabets  BSTJ  Vol.  31  pp.  50^-22  May  1952, 

Glenn,  A.s 

I  -  Comparison  of  PSK-AM  vs.  FSK-AM  and  PSK  vs.  FSK  Binary  Coded  Transmission 
Systems  Proceedings  Fifth  National  Communications  Symposium 
5  October  1959 • 

Hamming,  R, ! 

I  -  Error  Detecting  and  Error  Correcting  Codes  The  Bell  ^stem  Technical 
Journal,  Volume  29  pp.  Ili7-160  April  1950. 

Harris,  D.  P.  t 

1  -  An  Expanded  Theory  for  3ignal-to-Noise  Performance  of  FM  System  Carrying 
Frequency  Division  Multiplex  IRE  National  Convention  Record,  Part  8 
pp.  298-30);  March  1958. 

Hildebrand,  F,  B, ; 

I  -  Methods  of  Applied  Mathematics  Prentice-Hall,  Inc.  Article  1,13. 

Holland,  G.  and  Ifyrick,  J. ; 

I  -  A  2500-Band  Time -Sequential  Transmission  System  for  Voice-Frequency  Wire 
Line  Transmission  IRE  Transactions  on  Communications  Systems  Vol.  CS-7 
No.  3  PP*  I8O-I8I1  September  1959* 

Kerlson,  J.  and  Mermin,  N. ; 

I  -  The  Second-Order  Distribution  of  Integrated  Shot  Noise  IRE  Transactions 
on  Information  Theory  Vol,  IT-'^  June  1959. 


fOiinrl'.in,  A, ; 

1  -  I-uitheuntl  onl  Founrlatlons  of  Informtion  Ttieory  (Translated  by  SilvermaTij  R. 
and  Friedman,  M.)  Dover  Publications,  Inc.  New  York  1957» 

Kin,  W.  i’,  and  Froiman,  V,; 

I  -  Kulti -Error  Correcting  Codes  for  a  Binary  Asymmetric  Channel  IRE  Trans¬ 
actions  on  Circuit  Theory  Vol,  CT-6  Sjxjclal  Supplement  pp.  71-78 
May  19  (>'9. 

Lira  nr,  J.  II.  and  Babtin,  R.  H, ; 

I  -  R."Lndom  Processes  in  Automatic  Control  McGraw-Hill  Book  Company  1956* 

La-'ton,  J,  G.! 

1  -  . Comparison  of  Binaiy  Data  Trnncniecion  Sj'ctcmc  Published  in  19^8  Conference 
Proceedings  Presented  at  the  Second  National  Convention  on  Military 
Electronics  16,17,18  Jtme  1958. 

II  -  Theoretical  Error  Rates  of  Differentially  Coherent  Binary  and  Kineplex 
Data  Transmission  Systems  Published  in  the  Proceedings  of  the  IRE 
Vol.  )i7  fio.  P  p.  3.33  February  1959. 

Le  e ,  C .  .  I 

I  -  Some  Proportiei;  of  Monbinag;,'  Error-correcting  Codes  IRE  TransationvS  on 
Infomation  Tlicory  Vol.  IT-li  pp.  77-82  1958. 

Turner,  R. ; 

I  -  The  Representation  of  Signals  IliE  Transactions  on  Information  Theory 
Vol.  IT-5  May  1959. 

Lincoln  Laboratory,  MIT; 

I  -  Quarterly  Progress  Report  DivlBion  3  Radio  Physics  15  January  1959. 

Marcum,  J.  I . : 

I  -  A  Statistical  Theoiy  of  Target  Detection  by  Pulsed  Radar  Mathematical 
Appendix  RM-753  Rand  Corporation  25  April  195?. 


Merta,  P# r 

I  -  Model  of  Impulsive  Noise  for  Data  Trcinsmission  Rand  Corporation  Report 
No.  P-1761  27  July  1959. 

Middleton,  D.r 

I  -  On  the  Theory  of  Random  Noise  Phenomenological  Models  I  and  II,  and 
erratum  Journal  of  Applied  Physics  22  pp.  im3-ll52,  1153-1163,  1326 
1951. 

n  -  An  Introduction  to  Statistical  Communication  Theory  McGraw-Hill  Book 
Company,  New  York  pp.  3h9,  h90-li98  I960. 

HI  -  Optimum  Threshold  FSK  Commimication  with  Decision  Rejection 
AFCRC-TR-60-137  April  I960. 

Middleton,  D.  and  van  Meter,  D.r  . 

I  -  On  Optimum  Multiple-Alternative  Detection  of  Signals  in  Noise 

IRE  Transactions  on  Infornnation  Theory  Vol.  IT-1  pp.  1-9  1955» 

II  -  Detection  and  Extraction  of  Signals  in  Noise  from  the  Point  of  View  of 
Statistical  Decision  Theory  Journal  of  the  Society  for  Industrial  and 
Applied  Mathematics  Vol.  3  pp.  192-253  1955 J  Vol.  I*  pp,  86-119 

1956. 

Morita,  M.  and  Ito,  S. : 

I  -  High  Sensitivity  Receiving  System  for  Frequency  Modulated  Wave 

IRE  International  Convention  Record,  Part  5  pp.  228-237  March  I960. 

Hosier,  R,: 

I  -  A  Data  Transmission  System  Using  Pulse  Phase  Modulation  Convention 

Record  of  First  National  Convention  on  Military  Electronics  Wasliington,  D.C 
17-19  June  1957. 

Mood,  A.  McF. t 

I  -  Introduction  to  the  Theory  of  Statistics  McGraw-Hill  Book  Company, 

New  York  1950. 


Mullen,  J.  A.  and  Middleton,  D. : 

I  -  The  Rectification  of  Non-Gaussian  Noise  Quarterly  of  Applied  Matheniattrs 
Vol.  15  pp.  395-1119  1958. 

Nuttall,  A,  H,; 

I  -  Technical  Note  on  Pulse  Compression  and  Coded  Waveform  Techniques 
Melpar,  Inc.  15  March  1959  ASTIA  Document  No.  AD-219116, 

Peterson,  W. ,  Birdsall,  T.,  Fox,  W. ! 

I  -  The  Theory  of  Signal  Detectability  IRE  Transactions  on  Information  Theory 
Vol.  PGIT-h  September  195!i. 

Prtoe,  R. } 

I  -  The  Search  for  Truth  IRE  Transactions  on  Information  Theory  ^  Vol.  IT-5 
June  1959. 

Reed,  I.S. f 

I  -  A  Class  of  Multiple-Error-Correcting  Codes  and  the  Decoding  Scheme 

IRE  Transactions  on  Information  Theory  Vol.  PQIT-li  pp,  36-1*9  195li* 

Rfiiger,  S.t  , 

I  -  Error  Probabilitiec  on.  Binary  Data  Transmission  Systems  in  the  Presence 
of  Random  Noise,  Part  8  Convention  Record  of  the  IRE  1953* 

Rice,  S.  0,! 

I  -  Statistical  Properties  of  a  Sine  W.-.  Plus  Random  Noise  BSTJ  p.  109 
27  January  19li8. 

II  -  Mathematical  Analysis  of  Random  Noisp  Selected  Papers  on  Noise  and 
Stochastic  Processes  Dover  Publications,  Inc.,  New  York  p.  15I1, 

Eq.  (1.5-h)  195li. 

Rosenblatt,  F, t 

I  -  Percoptron  Simulation  Experiments  Project  PARA  Cornell  Aeronautical 
Laboratory  Report  No,  VO-1196-G-3  June  1959. 


Rutgers  University: 

I  -  Progress  Report  No,  8  Theoretical  and  Experimental  Research  in 
Communications  Theory  and  Applications  15  July  1953* 

Sanders,  R.  W.: 

I  -  Digilock  Communication  System  I960  IRE  WESCON  Convention  Record, 

Pt.  5  August  23-26,  i960. 

Shannon,  C.  and  Weaver,  W,: 

I  -  The  Mathematical  theory  of  Communications  diversity  of  Illinois  Rress 
Urbana,  Illinois  19ii9* 

Slebert,  W.  M.: 

I  -  A  Radar  Detection  Philosophy  ERE  Transaotlona  on  Information  Theory 
Vol.  lT-2  pp.  20la-221  1956. 

Siforov,  V.  I.: 

I  -  On  Noise  Stability  of  a  System  with  Error-Correcting  Codes  SiE  Than- 
saotions  on  Infcormatlon  Theory  Vol.  lT-2  pp.  109-115  1956* 


Skinner,  P,  J.s 

I  -  Radio  Transmission  Systems  -  Theoretleal  Noise  Ferformanoe  Curves  for 
Frequency  Modulation  Receivers  Operating  Below  the  BreakdJig  Region 
BTL  unpublished  memo,  file  36690-1  1  February  I95U* 

Slack ,  M. : 

I  -  The  1%'obablllty  Distributions  of  Sinusoidal  Oscillations  Combined  in 
Random  fhase  Journal  of  Institute  of  Electrioal  Engineers  93*  Part  3 
19li6. 

Slade ,  J .  J . ,  Jr ■ ,  et  al : 

I  -  Detection  of  Information  by  Moments  IRE  Convention  Record,  Information 
Theory,  Part  8  March  1953. 

II  -  Moment  Detection  and  Coding  lhansactions  AIEE,  Part  I  p,  275  July  1957* 

Sleplan,  D. : 

I  -  A  Class  of  Binary  Signalling  Alphabets  The  Bell  System  Technical 
Journal  Vol.  35  PP.  203-23it  January  1956. 


Sugar,  G.  R. : 

I  -  Some  Fading  Characteristics  of  Regular  URF  Ionospheric  Propagation 
Proceedings  IRti  pp.  Iij32  October  1955* 

Sunde,  E.  D. ; 

I  -  Theoretical  Fundamentals  of  Pulse  Transmission  Bell  Telephone  System 
Monograph  228U. 

II  -  Ideal  Binary  Pulse  Transmission  by  AM  and  FM  BSTJ  pp.  1357-lii26 
November  1959. 

Sylvania  Electric  Products,  Inc.: 

I  -  Anti-Jamming  Techniques  Study  Final  Report  (SECRET  Report) 
(UNCUSSIFIED  Title)  October  30,  1957  AD-Ui8671 

Taber,  John  E. : 

I  -  The  Telebit  System  for  Space  Communication  I960  IRE  WESCON  Convention 
Record,  Pt.  5  August  23-26,  I960. 

Trabka,  S.  A.i 

I  -  Detectability  of  IFF  Transmissions  and  Susceptibility  of  the  System  to 
ECM  (UNCUSSIFIED  Title)  CAL  Memo  (SECRET)  July  8,  1958  NOT  RE¬ 
LEASABLE  TO  FOliBION  NATIONALS. 

II  -  Detectability  of  IFF  Transmissions  by  an  Autocovarianoe  Filter 

(UNCLASSIFIED  Title)  CAL  Memo  for  the  Record  .  (SECRET)  November  13, 
1958  NOT  RELEASABLE  TO  FOREIGN  NATIONALS, 

III  -  Interception  of  Signals  Having  a  Large  Bandwidth-Time  Product  with  an 
Introduction  to  Pulse  Compression  Cornell  Aeronautical  Laboratory 
Report  No.  UB-1207-3-2  6  October  I960, 

Turin,  G.  L. : 

I  -  Communif  '■ion  Through  Noisy,  Random-Multipath  Channels  Massachusetts 
Inst,  of  Technology,  Lincoln  Laboratory  Tech.  Report  No.  116 
lii  May  1956. 


Turin,  G.  L. : 

II  -  On  the  Estimation  in  the  Rresence  of  Noise  of  the  Impulse  Response 
of  a  Random,  Linear  Filter  IRE  Transactions  on  Infomation  Theory 
Vol.  IT -3  No.  1  pp.  5-10  March  195?. 

Ill  -  Error  Rrobahilities  for  Binary  Symmetric  Ideal  Reception  through 

Nonselective  Slow  Fading  and  Noise  Rroceedlnga  of  the  IRE,  Vol.  1;6, 
pp.  1603-1619  September  1958. 

IV  -  The  Asymptotic  Behavior  of  Ideal  M-ary  Systems  Proc.  IRE  Vol.  Ii7> 
January  1959  pp.  93-9U. 

V  -  An  Introduction  to  Matched  Filters  IRE  Transactions  on  Info.  Theory 
Vol.  IT-6  No.  3  June  I960. 

Ulrich,  W. : 

I  -  Nonbinary  Error  Correction  Codes  Bell  System  Tech.  J,,  Vol,  36  1957 
pp.  13iil-1388. 

Voelcker,  H.,  Jr.; 

I  -  Single  Channel  Radioteletype  Communication  Raper  Presented  at  1958 
IRE  National  Convention  March  27,  1958. 

Walbesser,  W.  J.: 

I  -  Error  Correction  Coding  as  a  Statistical  Game  Cornell  Aeronautical 
Laboratory,  Inc.  Internal  Memorandum  dated  15  August  ..i960 . 


Watson,  G.  N. ; 

I  -  A  Treatise  on  the  Theory  of  Bessel  Functions  The  MacMillan  Company, 
New  York,  19ii5. 

I'/hittaker,  E.  T.  and  Watson,  G.  N.; 

I  -  A  Course  of  Modern  Analysis  The  MacMillan  Company,  New  York  19ii6. 
Weber,  L. : 

I  -  A  Frequency-Modulation  Digital  Subset  for  Data  Transmission  over 

Telephone  Lines  Communications  and  Electronics  No.  UO  January  1959 
pp.  867-872. 


Woodward,  P. : 

I  -  Probability  and  Information  Theory  with  Applications  to  Radar 
McGraw-Hill  Book  Company,  Inc.  New  York  1955. 

Wolfowitz,  J.; 

I  -  The  Coding  of  Messages  Subjected  to  Chance  Errors  The  Illinois 

Journal  of  Mathematics  Volume  1  No.  1;  pp.  591-606  December  1957. 

Wozencraf t,  J . : 

I  -  Active  Filters  U.  S.  Patent  Applications  and  Signal  Corps  Patent 
Agency  Docket. 


GLOSSARY 


AM 

Amplitude  Modulation 

BCPPSK 

Binaiy  Coherent  Pulsed  Phase  Shift  Keying 

BDCPSK 

Binary  Differentially  Coherent  Phase  Shift  Keying 

CPSK 

Coherent  Phase  Shift  Keying 

DCPSK 

Differentially  Coherent  Phase  Shift  Keying 

E 

Average  Signal  Energy  per  Signal  Element 

FM 

Frequency  Modulation 

f 

Frequency  in  Cycles  per  Second 

OPSK 

Gated  Phase  Shift  Keying 

HF 

High  Frequency 

A 

Duration  of  Burst 

HF 

Matched  Filter 

Noise  Power  Density  per  Cycle  per  Second  of 

One  Sided  Spectrum 

PC  ) 

Probability  of  Quantity  In  Parenthesis 

PPSK 

Pulsed  Phase  Shift  Keying 

PSK 

Phase  Shift  Keying 

Mean  Signal  to  Noise  Ratio 

T 

Duration  of  One  Signal  Element 

W 

Signal  to  Noise  Ratio 

GREEK  SYMBOLS 

T  .4  f 

A 

Phase  Difference 

Correlation  Coefficient 

525 

Phase 

(t) 

Radian  Frequency,  Rad/Sec. 
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Subject:  "limbodimentn  of  the  Maximum  Likelihood  Receiver  for 

Detection  of  Coherent  Pulned  Phase  Shift  Keyed  Signals 
in  the  Presence  of  Additive  Vfhite  Gaussian  Noise" 

By!  Eugene  A.  Trabka 


SUMMARY 

Embodiments  of  the  optimum  (maximum  likelihood)  receiver  for  the 
detection  of  Coherent  Phase  Shift  Keyed  Signals  in  the  presence  of  additive 
V/hite  Oauseian  Noise  are  described  (Figs,  l.and  2),  A  "practical"  receiver 
(Fig,  li)  is  analyzed  and  the  performance  of  this  "practical"  receiver  is 
found  to  approach  that  of  the  maximum  likelihood  receiver  as  the  number 
of  cycles  in  the  pulsed  sinusoid  increases . 

INTRODUCTION 

Consider  a  set  of  m  signals  consisting  of  pulsed  sinusoids  of  a 
single  angular  frequency  ,  each  having  a  rectangular  envelope  of 
duration  T  and  amplitude  A,  The  phases  of  the  signals  are  taken  to  be 
uniformily  spaced  in  the  int9n’’al  from  0  to  ?  7^’  .  Thus,  one  has  for 
i  =  1,  2,  . . . ,  m 


A 

-d.  it)  =  0 

O 

0.  = 


0-) 


m 


0  <t  <r 
t<0.  t>T 


(1) 


^f-Thls  is  a  revision  of  DETECT  MlfMO  NO.  5  which  was  originally  issued 
29  August  I960. 
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and  It  is  assumed  that  T  >>  1  which  implies  narrow  band  signals  having 
many  cycles  in  the  interval  T.  If  Sj^(t)  is  transmitted,  the  received  wave¬ 
form  is  assumed  to  be  given  by 

y  (t)=  ^^(t)  i- n(i:)  (2) 

where  n(t)  is  a  member  of  an  ensemble  of  white,  gaiissian  noise  with  single 
aided  power  spectral  density  of  N^  watts/cps. 

It  has  bean  shown^^^  that  a  receiver  which  decides  that  the  signal 
actually  sent  corresponds  to  the  one  having  the  greatest  aposteriori 
probability  (such  a  receiver  is  called  .a  maximum  likelihood  receiver)  mini¬ 
mizes  its  average  error  probability.^'"  Moreover,  a  physical  embodiment  of  a 
maximum  likelihood  receiver  in  terms  of  matched  filters  or  correlation 
devices  is  well  knovm. 

A«  Embodiments  of  the  Optimum  Receiver 

The  nn.rinun  likelihood  receiver  computes  the  quantities: 

T 

^  f 'y  (t)  (3) 

o 

If  the  signals  are  all  a  priori  equally  likely,  the  receiver  chooses  the 
value  of  0^  for  which  0^(T)  is  a  maximum.  The  quaiitity  0^(T)  can  be  obtained  as 
the  output  at  time  t  •  T  of  a  filter  matched  to  s^(t),  i.e,,  a  filter  with  ingjulse 
response  s^(T  -  t) .  The  output  of  such  a  filter  as  a  function  of  time  is 


^^A  different  choice  of  Sj(t)  may  yield  a  lower  average  error  probability. 
The  optimum  choice  of  signals  is  not  known  for  arbitrary  m. 
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is  given  by 

t 

0^  (t  )  ~  ^  j/  (  ^”1*'  ^  ^ (Ij) 

o 

and  (3)  is  readily  obtained  by  substituting  t  ■  T  in  (li). 

The  receiver  described  above  and  sketched  in  EUg.  1,  requires  m 
different  filters.  This  number  may  be  reduced  by  noting  that  using  (1), 
equation  (3)  may  be  written  as 


where 


T 

y* y  (t)  A  Aun.  CeJ^t  dt 

fS 

r 

^  t  oLt 

0 


(5) 


(6) 


Thus,  all  Oj^(T)  may  be  foimed  usiig  the  outputs  of  only  two  filters. 
Furthermore,  by  means  of  the  transformation 

0^(T)  1/ 

A  (7) 

0^  (r)  =  1/  0 


equation  (5) 


may  be  written  as 


A 

n.  (T)  -  d  -  i>) 


(8) 
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uhere 

I' ' 

1  0  (T) 

0  =■  cUl^X^tx.  - 

A 

If  0j  -  0  ia  reduced  to  the  equivalent  angle  in  the  range  from  -  to 
+  'Tt  ,  then  0^(T)  is  a  maximum  when  \  0^  -  0  |  is  a  minimum.  A  maximum 
likelihood  receiver  baaed  on  the  above  considerations  is  sketched  in  Fig.  2. 

A 

It  is  not  difficult  to  show  that  the  quantity  0  Is  &  maximum  likelihood 
estimate  of  the  phase  of  a  transmitted  signal  which  is  apriori  uniformily 
and  continuously  distributed. 


B.  An  Approximation  to  a  Maximum  Likelihood  Receiver 
Using  Unequal  Sampling  Times 


The  Impulse  responses  of  the  m  matched  filters  specified  in  A 
are  identical  except  for  phase.  Consequently,  it  is  interesting  to  examine 
the  output  of  one  filter,  say  the  one  matched  to  s, (t),  when  s.(t)  is 

W  XU 

actually  transmitted.  Let  the  output  of  the  filter  matched  to  the  i 
signal  when  the  signal  is  actually  transmitted  be  denoted  by  Oj^j(t), 
Using  the  fact  that  ■  0,  one  has  from  (1),  (2),  and  (1*). 


Oij  it]  =  XUnn,  (  Cju^X  -h  <py)  ^  (  T-t  t  X)  rix. 

0 

A  ^  n  (Z)  A4>n  (ju^  (r- t  +  z)  oCst 
0 


(10) 


k 


SAMPLE  AT 

t  -  r 


fi  -  INDEX  CORRESPONDING  TO 
SMALLEST  |  -  ^  | 


Figure  2  PHASE  MEASURING  EMBODIMENT  OF  MAXIMUM  LIKELIHOOD  RECEIVER 
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Sampling  O^j(t)  at  timea  ■  T  011*  from  (10) 

T-  -1 

r.^ 

-  tM  I  f7(z}  {(Ji>^  Z  +  <p^)  d/jc 


2rr 

zfr^'a 


where  P  is  the  period  corresponding  to  f^.  Consequently,  if  P<<  T,  it 
is  seen  that  the  statistics  of  0]_j(t^)  are  very  nearly  the  same  as  the 
statistics  of  Oij(T),  which  may  be  written  symbolically  as 


Oij  (ti  ) 


Oq  (t) 


In  the  case  when  there  are  many  cycles  of  sin  t  in  the  interval  T,  the 
performance  of  the  receiver  of  Fig.  3  is  nearly  equivalent  to  that  of  the 
optimum  receiver.  The  number  of  matched  filters  has  been  reduced  to  one, 
but  the  r'^quirement  of  m  distinct  and  precisely  timed  sampling  instants 
may  be  unattractive. 
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C.  A  "Practical"  Receiver 

Let  the  first  term  of  (10),  the  component  of  the  output  due  to 
signal  be  denoted  by  Then,  expanding  the  integrand,  it  is  possible  to 

write 

'  (111) 

I 

If  there  are  many  cycles  of  cos  t  in  the  interval  T,  it  is  permissible 
to  neglect  the  second  term  of  (lii),  so  that  for  t  near  T,  one  has 

i  t)  ^  ^  "■  ^6 

so  that  the  phase  of  the  component  of  the  output  due  to  signal  in  each  case 
differs  from  the  phase  of  the  transmitted  signal  by  dtJ^^T  which  is  independent 
of  The  above  argument  suggests  a  receiver  of  the  type  shown  in  Fig#  Ii, 

which  will  be  called  a  "practical"  receiver  (for  want  of  a  better  name)  since 
it  requires  only  a  single  matched  filter  and  a  single  sampling  of  phase  at 
time  t  «  T.  It  is  similar  to  the  receiver  of  Fig,  2  differing  only  in  the 
manner  in  which  estimates  of  phase  are  obtained.  It  remains  to  be  detemined 
whether  or  not  it  is  equivalent  to  a  maximum  likelihood  receiver. 
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AMAIZSIS  OF  "PRACTICAL*  RECEIPER  FOR  m  ■  2  AND  «  ■  U 

Error  probability  ourves  for  n-state  CP5KS  employing  the  praotioal 
receiver  of  Fig*  ^4  have  been  published  by  Cahn^^^.  The  output  of  the 
matched  filter  in  Fig.  I4  due  to  both  signal  and  noise  may  be  considered  to 
be  narrow-band  whan  it;  gT«  1  and  may  bo  axprossed  in  terms  of  envelope 
and  phase  as 

i/(t) 


An  ideal  detector  is  usually  assumed  which  operates  on  0(t)  to  produce  an 
output  0(T),  In  Ref.  (3),  it  was  showi  that  the  probability  density 
of  (assuming  without  loss  of  generality  that  0^^  ■  0  was  sent)  is  given 
by 


a 


(17) 


where 


(18) 


is  the  ratio  of  signal  energy  per  pulse  to  the  noise  power  density  (eval\uted 
at  input  to  receiver).  The  error  probability  of  an  m  state  CPSKS  using 
the  practical  receiver  of  Fig.  It  is  then  given  by 

ftr/fn 

P  {fr))=  1-2  f 

*  0 
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I 


Substituting  (17)  into  (19)  and  changing  to  rectangular  coordinates  according 
to 

U.  =  ^0  V 

V  =  JO  gj  (20) 

one  finds  that 


u.  tan  -=r 


j  t~^*ciAr 


The  double  integral  for  P(m)  is  easily  evaluated  for  m  ••  2  and  yields 


which  is  identical  to  the  error  probability  obtainable  with  the  optimum 
receiver  of  Fig.  1  as  derived  in  Ref.  U, 

For  m  “  U,  P(m)  may  be  evaluated  by  taking  the  derivative  of  p(in)  with 
respect  to  S  (as  is  shown  in  the  Appendix  to  this  report)  and  yields 


It  has  not  been  possible  to  evaluate  (21)  in  closed  form  for  m  >  ii. 


( 
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ANALYSIS  OF  MATCHED  FILTER  EMBODIMENT  OF 
MAXIMUM  LIKEUHOQD  RECEIVER  FOR  ■  -  li 

The  following  analysis  of  the  maximum  likelihood  receiver  of  Fig.  1 
for  the  special  case  when  m  ■  li  was  attampted  in  the  hope  that  it  might 
readily  generalize  for  arbitrary  m.  Although  this  does  not  appear  to 
be  the  case,  and  in  spite  of  the  fact  that  (23)  may  be  directly  obtaineid 
for  the  error  probability  of  the  optimum  receiver  for  m  ■  U  by  considering 
it  to  be  composed  of  two  independent  binary  channels,  the  following 
argument  is  of  academic  interest. 

From  (2)  and  (3)  one  can  write 


i-N. 

i 


Ct)  it) 


dt 


{2h) 


Using  (1),  it  can  be  shown  that  if  »1, 

5.^.=  £  (25) 

A 

where  the  energy  per  pulse  is  given  by  E  ■  J  AT.  Moreover,  the  covariances 
of  the  noise  components  of  the  output  are  given  by 


Expected  Vo-lae 


(26) 
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where  .  Assuming  again  without  loss  cf  generality  that  S||^(t) 

was  sent,  the  probability  of  error  is  given  by 


PfvJ 


[ 


/  *  Pipoh  j  Ojif  ^  Off  p  Oji  ^  Off  f  Oiff  ^  Off 


] 


(27) 

•p( Oft  t  Ojit  t  ^31 1  ^vt) 


and  the  probability  density  p  O21*  ^31*  ^lil^  obtained  from 

the  Joint  probability  density  f(N^,  N2>  N^)* 

In  a  Ij-state  system  ■  0,  \  ^ 

from  (26)  one  obtains 


~  f,  2,3,  ¥ 

</V,A'^>  -  </V,/V^>  -  -  <^3^¥>  -0 


(28) 


( 


which  indicates  that  and  «•«  independent  of  Ng  and  N^.  Therefore, 
one  can  >..”ite 


^(N,,Ni,Nj,N„)  -  h(Nj,,N„)  (29) 


and  fj  (21;) 


N3  -  -  N, 
N,,  -  -N, 


(30) 


I 
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Figure  5 


defined  by  Fig.  5  ia  given  by 


^s')  ^  ,  . ^  e  ci'(N^) 

p-rrs- 


,  5  o 

where  cr  •  2  (T  ' ,  Since 
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one  obtalna 


i¥Tre-^  ^ 


8<r» 


(33) 


and  a  similar  esqpreasion  for  h(N2»  H^).  Using  (2U)  and  (25)  yields 


P(^ll  t  ^21  t  Oji  ,  Ojf/) 


f 

VTTo"* 


(0„-0„-2£/ 

e  i9(r 


(Ojtt  -  Out) 

Wa^ 


If 


(31;) 


Perfoming  the  Integration  indicated  in  (27)  with  respect  to  Og^  and 
by  first  changing  to  the  variables  x  ■  y  “  f^t 


Hi 
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(Ozi 


Ojii) 

2. 


<9cr 


Om  ^  Oiji  'N  _ 

/T  y 


Cx  -  v  / 

dix^  ij)  » 


(35) 


Consequently,  (27)  reduces  to 


P(^)  =  r' 


TTO" 


<9ir  ■ 


°\  /T  / 


/_oo  I  >^-00 


e'^'aSf 

L‘'o 


1 


(^^31 j 
(36) 


and  again  letting  x  -  0^^^/  /T,  y  -  0^^/  /T  gives 


P(v)  -  /■ 


7r<s" 


e  cr(t^^) 


''-OO  {J'-oo 


1 

■ka 

L_ 

■■ 

/  e~'^oUr 

cLj 

io 

(37) 
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which  reduces  to 


P(¥)  -  1  ■ 


e  dt] 


(38) 


and  letting  ▼  ■  t/a*  and  u  ■  ,  one  finally  obtains 

- -4- /  ( ei^l  vLl 


(39) 


where  S  ■  »  *  /sAT  *nd  (39)  Is  seen  to  be  Identical  to  (21)  for 
m  -  lit  This  establishes  the  equivalenoe  of  the  optlaun  and  praotioal 
receiver  for  n  ■  U« 


( 

EQUI7AI2NCS  OF  "PRACTICAL  RECEI91R"  AND  MAZIMDM 
LimLiaX)D  HEOaiVER  FOR  ARBITRAHr  a _ 

The  opraetioal"  receiver  of  Fig*  U  oani  for  arbitrary  a  be  shown  to  be 
equivalent  to  a  aaxLann  likelihood  reoelver  by  showing  that  Its  perfonnenoe 
is  equivalent  to  that  of  the  reoelver  of' Fig »  2*  As  wee  pointed  out  prevl* 
ouslyi  the  reoeivers  of  Figs.  2  and  k  differ  only  in  the  manner  In  vhloh  th:^" 
rea^otlva  estimates  ^  and  |[f*  of  phase  are  obtained*  The  probability  density 
of  0  will  be  shown  to  be  Idantloal  to  that  of  0*. 

Again,  assuming  that  S2^(t)  was  transmitted,  It  is  possible  from  (6)  to 
escpress  equation  (5)  as 


Oi  ■  «C04  (Pi  ^  -^in  <pl 


m 


i 
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where  the  Joint  density  of  and  Ng  is  given  by 


P(N,,/^2)  = 


/V/ 


2TTe-' 


2  0-^' 


(lil) 


2  ®"o 

and  <r  ■  — j-  .  The  substitutions  (7)  become 

A 

£  +  Nf  -  V  0 

A 

Nz  “  V  2.in  (p 

A 

and  the  probability  density  of  0  may  be  shown  to  be  identical  to  p(^)  as 
given  by  equation  (17)  of  this  report  in  precisely  the  same  manner  that 
equation  (13)  of  Ref,  3  was  obtained  from  equation  (7)  of  Ref,  3, 
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APPENDK 

Evaluation  of  P(m)  For  n  »  U 


From  aquation  ( 21) ,  one  may  write 


P(m,  S)  -  /• 


-Cu~S)  / 

{?  e  t 


e  aUr  du. 


which  upon  letting  y  -  u  -  S  becomes 


where 


P(m,S)  -  J  dtj 


so  that  using  Leibniz'  Rule,  one  has 


oL^  i"  ■f  (~  S  f  3) 


where 


TT  ~  tan^ 

^  tftn  ——  e  ^  rii 

177 


and  hence. 


/lo®  r  ^  2  TV  ^  ^  7r  ^2^  z  rr~[ 

dP  ^  J-  to.  /  fi.  ‘  1/  “J 

^5  TT  " 
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Completing  the  square  in  the  exponent  of  the  integrand  yields 


»  >77 

SP  2  TT  -S  Mn  ~ 

dS  Tl 


^ec 


0^ 


and  making  the  substitution  x  -  seo  S  sin^  gives 


dS 


^  Jt  ^ 

-  7J,.  ^1/)  ^  tf 


i  .  i  tt 

-5  ^ 


0^ 


•  5 

/T?  — 


2.  •  jr  f/W  ^ 

TT  m  ^  j  2 

1 0 


S6tU.  ^ 


If  one  now  lets  m  ■  U  so  that  sin  ■■  oos  then  it  is  found  that 

m  m  ^ 


where 


^  rfT 


ir 


S- 

e  6Uc 
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and  consequently. 


P 


1  y-*  S 

'  ¥  ■‘V  /T 


where  the  constant  C  may  be  evaluated  by  considering  the  original 
expression  for  P(m|  S)  at  S  ■  0,  This  yields  C  ■  3A  ond  recalling  that 
,  one  obtains 
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Subject r  "Eri'or  Probability  (in  the  Presence  of  Sampling  Time  Errors) 
of  the  Cross  Correlation  Embodiment  of  a  Maximum  Likelihood 
Receiver  for  Binary  Coherent  Gated  Phase  Shift  Keyed  Systems 

(BCGPSKS)" 

Byr  Eugene  A,  Trabka 

SUMMAIg 

The  cross  correlation  eubodiment  of  a  maximum  likelihood  receiver  for 
m-3tate  coherent  gated  phase  shift  keyed  systems  is  introduced.  The  error 
probability  of  such  a  binary  receiver  is  obtained  in  the  presence  of  sampling 
time  errors . 

mTRODUCTION 

In  Reference  1,  several  embodiments  of  the  maximum  likelihood  receiver 
for  the  detection  of  m-state  coherent  pulsed  phase  shift  keyed  signals  were 
investigated,  The  purpose  of  the  investigation  wasl  to  compare  a  "practical" 
embodiment,  which  required  only  one  filter  regardleas  of  the  number  m  of 
phase  states,  with  a  matched  filter  embodiment  whidh  requires  m  distinct 
filters  . 

In  order  to  complete  the  discussion  of  the  embodiments  of  maximum  likeli¬ 
hood  receivers  for  CPSK  systems,  the  present  memo  analyses  the  performance  of  a 
cross-correlation, embodimsnt.  Moreover,  since  this  embodiment  is  particularly 
suited  for  the  detection  of  coherent  gated  phase  shift  keyed  signals,  this 
form  of  the  coherent  phase  shift  keyed  signals  will  be  used.  Since,  as  is 
pointed  out  in  Chapter  II,  it  does  not  appear  reasonable  to  consider  gated 
oneration  with  a  frequency  error,  only  errors  in  sampling  time  will  be 
con.'jidored.  Eocusing  attention  on  thu  particular  signal  interval  from  0  to  T  , 

~  In  Chapierli,  the  difference  between  pulsed  and  gated  PSK  systems  is 
discussed  and  it  is  pointed  out  that  closely  analogous  embodiments 
of  the  respective  receivers  are  possible. 
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it  vas  assumed  in  Reference  I  that  the  m  noasible  signals  are  of  the  form 

(t)  -  U.  (^/t)  t  t  0^  (1) 

where  u,  (‘x)=1  for  0  ^  ^  ^  1  and  u.  (?:)=0  elsewhere, 
and  0 .  =  ^  (I  -  f)  for  i  ~  If  2.^  .  ,  ,  m  t  Moreover,  it  was  pointed 
out  in  Reference  1  that  the  maximum  likelihood  receiver  requires  the  cor^nitation  of 
the  quantities 

r 

0^-(r)=J di  (2) 

a 

in  which  is  the  input  to  the  receiver  assumed  to  be  of  the  form 

if  (t)  =  A.  (t)  -h  n  (t)  (3) 

where  is  the  actual  transmitted  signal  and  n('t\  is  a  sample  of  white 

Gaussian  noise  vri.th  single -.sided  power  spectral  density  watts/cps,  A 

block  diagram  of  the  crosE-correlaticn  receiver  ^rtiicli  computes  the  quantities  0^(t) 
as  given  by  (2)  is  shovm  in  Figure  1.  The  box  labeled ’tontrol"  causes  the  com-’ 
j)arator  to  determine  at  sampling  times  t  =  '^  T  ,  where  is  an  integer, 

which  0'  produces  the  largest  voltage  at  its  input.  Moreover,  the  control 
unit  discharges  the  integrators  at  t  =  ^  T  , 


2 


CORRELATOR 
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Figure  1  CROSS-CORRELATION  EMBODIMENT  OF  MAXIMUM  LIKELIHOOD  RECEIVER 
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ERROR  PROBABILITY  IN  TRE  PRESENCE  OF  SAMPLING  TIME  ERRORS 


Tlie  transmitted  coherent  gated  phase  shift  keyed  signal  is  assumed  to  be 
of  the  form 


^  (t)  =  ^  t  -h  e^'j 

•=-«<) 


ill) 


where  the  are  independent  random  variables  designating  the  transmitted 
phase  in  the  kth  interval.  The  all  have  identical  discrete  probability 
distributions,  viz 


Prob. 


i  —  1  i  2.f 


m 


(5) 


If  an  error  ^  T  is  made  in  the  sampling  time,  then  the  comparator  chooses  the 
1ar:;oEt  of  the  quantities 


r  y/ir 

o.(ri-AT)-  =  J  n(t)4.i(t}dt  <« 

AT 

instead  of  the  quantities  (2).  Using  (1),  (3)  and  expanding  (6),  it  is  possible 
to  vrritG 

n  ( r-hAT)  =  -h  n.  (7) 


h 


where 
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r-t-AT 


A-{i)  /J  A-cm.  f 


Air 

^  r^AT 


n ^  -J"  in(t)  A 

AT 

If  fn=  2  ,  then  0^=0  and  0^  7t  and  it  is  easily  seen  that 

,  and  /7^  =  ~/0f  so  that  0^  (rtAr)  -  -  O,  (TtAT) 
and  the  error  probability  (assuming  without  loss  of  generality  that  actual 
transmitted  phase  in  the  relavent  interval  is  =  0^  -  0  j  given  by 

P(2]=  Prob.'^  O,  (TtAT)  <  0^  (Ti^AT^ 


reduces  to 


P(2)  =Prob.^j{T+AT)  <  0^ 


It.  is  easily  ascertained  that  has  a  Gaussian  distribution  v?ith  zero  mean 

.and  variance  &'  =  vdiere  F.  —  ■  AT  so  that  (10)  becones 


^(2;  =  —  /; 


{2¥‘ 
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Substituting  (h)  into  (8)  and  assuminc  0  ^  AT  <  T  ,  it  is  found  that 

JLI=  f  (9  1  C£j^  t  dt 

^  ir  (12) 


/  /  /4  j  f  ■/•  9, 


CeJ^t  cLt 


which  can  be  vnritten  as 


(  r 


>  2 


J  cCt  -^(^{2 

/5T  ‘'at 


(13) 


A*" 


TfAT 


r-f-AT 


e^dt  -J  9  )  dt 


so  ttiat  one  finally  obtains 

f 


1  -  -4J-)  yC^  e  i-  ~  9 

T  I  o  T 


Z«i>  T 

O 


Adn- [^2  (jeJ^T+O^-AArul^oAT  9^)  (lit) 


■f  Aun,  2CQjr  [  1-t 


AL 

T 


J 


—  Adru  [ 2  Ca^T  f-  9 
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Conslderinc  from  (lU)  as  a  function  of  — — —  with  parameter  j 

it  is  easily  shorn  that 


/^ni.  jLL^ 
CeJ  T — ►CO 

O 


0 


AL 

T 


(35) 


and  that  the  convergence  is  uniform.  Recalling  that  it  had  been  assumed  that 
6^  0  ,  it  is  possible  for  large  Ol)^  J  to  approximate  (lli)  by 

and  it  is  seen  that  depends  on  the  transmitted  phase  in  the 
succeeding  interval.  Since  9/  =  0  or  Tf  each  with  probability  1/2, 
one  obtains  for  the  average  error  probability  from  (11)  and  (16) 


(17) 


where  has  been  replaced  by  |^j  since  it  can  be  shown  that  (17) 

then  holds  for  —T  <.  AT  ^  0  also.  This  result  is  identical  to  the  error 
probability  obtained  for  the  "practical"  receiver  using  coherent  pulsed  phase 
shift  keyed  signals,  as  can  be  seen  from  comparison  with  equation  (21)  of  Reference  ?. 
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BY;  Eugene  A.  Trabka 


Consider  a  communicatioiiS  !r/stem  v;h,lch  can  transmit  vany  one  of  M 

n  •) 

sij-nals,  S.^(t)  i  =  1,  ...M,  oacb  of  duration  T.  It  has  been  shown'  '  that  for 
a  flven  set  of  signals  a  receiver  can  minimise  its  average  error  probability 
by  using  a  maximum  likelihood  detector,  i.c*,  decide  that  the  signal  having  the 
greatest  a  posteriori  probability  ms  sent.  The  input  to  the  receiver  y(t)  is 
usually  assumed  to  consist  of  the  transmitted  signal  plus  irtiite  Gaussian  ncise 
vrlth  single-sided  power  spectral  density  N  watts/cps.  From  trte  identity 

it  is  possible  to  express  the  a  posteriori  probability  of  given  the  receiver 
input  y  as 

P(S./!,)  =  *,  P(S.) 


However,  y(t)  - 


one  find.s  that 


Sj(t)  ■  n(t)  and  since  it  can  be  shovm''^'  that 
^  r 


r-kS 


P(n)  ^  -4^  e 

'  -V  <'■’ 


wl-orc 


/- 

/. 


r 

f  lE  (f)  .V/ 


is  the  energy  of  the  signal.  Tnus,  in  the  case  when  all  the  signals  are 
a  priori  equally  likely,  i.e.,  P(S^)  ^  ^  maximum  likelihood  detector  wxl' 
select  as  the  transmitted  signal,  the  S^(t)  for  which 


This  material  v/as  originally  published  as  Section  C  of  the  technical  discussion 
of  the  '•Technical  Proposal  for  Extension  of  Detection  Techniques  for  Digital 
Data  Transmission",  Contract  AF  30(60?)-2210,  submitted  by  the  Cornell  Aero¬ 
nautical  Laboratory,  25  August  1960, 


=  /  y{t)  SiU)  dt 

'^0 

is  the  greatest.  Such  a  receiver  may  be  realized  with  matched  filters  and 
Is  shown  in  Fig,  1  for  K  4.  It  should  be  noted  that  the  above  argument  la 


SAMPLE  AT 
p-r 


Figure  I  A  MAXIMUM  LIKELIHOOD  RECEIVER 


valid  when  the  M  possible  signals  are  taown  completely  to  the  receiver  (the 
so-called  coherent  case  without  random  parameters  such  as  phase). 

The  average  error  probability  depends  on  the  choice  of  signal  alphabet. 
Only  in  the  binary  case  M  •=  2,  is  it  known  how  to  choose  the  signals  so  that 


the  average  error  probability  is  the  minimum  posaibl.e.  The  probability  of 
an  error  assuming  was  sent  is  formally  given  by 

P  (Error /Si)  =  ! - P ( every  Oj  <  Oi )  J  #  i 

and  the  average  error  probability  is  given  by 

M 

P  (Error)  -  Pi  Error) 

l^t 

Sven  when  the  signals  are  specif led>  it  is  often  difficult  to  evaluate  the 
above  e:q)reaaiona  and  much  harder  to  visualize  how  the  S^(t)  should  be 
chosen  to  mlnlmiae  P(E)>  In  order  to  gain  insight  into  this  problem,  the 
heuristic  device  of  visualizing  maximum  likelihood  detection  geometrically 
in  D-dlmensional  space  is  often  used.  This  is  possible  through  use  of  the 
sampling  theorem  which  states  that  a  signal,  whose  energy  density  spectrum 
is  limited  to  a  band  W,  is  completely  detezmined  by  samples  spaced  — 
seconds  apart  in  time.  Thus,  In  the  interval  T  there  are  at  most  D  ■  2TVI 
numbers  required  to  specify  the  signal  and  these  nunibers  may  be  taken 
as  the  coordinates  of  a  point  in  D-dlmenslonal  space.  Thus,  to  each  signal 
S^(t),  there  corresponds  a  point  in  D-dimenslonal  space  with  coordinates: 

{ (ttv  /  ’  (iw)  ’ '  *  * '  (tw) 

It  is  possible  to  show  ^  'that  for  two  such  wavefoms,  say  u(t)  and  v(t) 
that 

2^1  u.(t)  'ir(e)  dt  ^21  <^(-^) 

^In  this  case,  the  signals  should  be  the  negative  of  one  another. 
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so  that  if  one  lets  u  ■  v  ■  Sj^»  it  is  seen  that  the  square  of  the  distance 
of  a  signal  point  from  the  origin  is  approximately  2WEi^  since  the  preceding 
equation  reduces  to 


st(t)  dt 

''  0  ;  =  / 

Moreover^  the  receiver  Input  y(t)  may  be  associated  with  a  point  in  the  same 
space  as  the  possible  transmitted  signals.  If  one  oonaldera  the  distances 
between  the  point  corresponding  to  y(t)  and  each  of  the  siijnal  points, 
namely 

-  L  [>>(7^)  -  Alir)  - 

J  J  J 


it  is  seen  that 


di  *  2W 


J 

f  i/^(t)dt-Z  f  i/(t)Si(t)dt 

*4  L'^o 

J  y  ^(t)  dt  -  20 1 


IL 

2 


m  2W 


80  that  the  maximum  likelihood  prooedui'e  of  selecting  that  Sj^(t)  which 
maximizes  0^  has  the  geometrical  interpretation  of  selecting  the  signal 
point  •vrtiich  is  closest  to  the  point  corresponding  to  the  receiver  input  y(t). 


Qilbert  ,  gives  an  approximate  formula  for  the  average  error 
probability  of  a  maximum  likelihood  detector  in  tezms  of  the  geome¬ 
trical  configuration  of  signals  in  signal  space*  It  is  interesting  to  apply 
Oilbert's  Foimula  to  M-state  Coherent  Phase  Shift  Keyed  Systems  (CPSKS)*  The 
signals  of  a  CPSKS  may  be  represented  as  points  in  a  2-dimen8lonal  space 
whose  polar  coordinates  are  the  amplitude  and  phase  of  the  carrier.  This  is 


k 


illustrated  in  Fig.  2  for  H  ■  8, 
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Figure  2  SIGNALS  OF  AN  H  -  8  CPSKS 


According  to  Gilbert,  the  average  error  probability  of  a  maximum  likeliliood 
detector  is  approximately  given  by 


P  ( Err  nr) 


^  dx. 


when 


jJWE 

(S' 


jJWE 

Jn^w 


>>  / 


5 


where 


2^^  ■  the  amalleat  of  the  distances  between 

pairs  of  signal  points. 

<5"  ■  total  power  of  input  noise  in  bandwidth  W 


and  N  is  determined  as  follows s  for  each  signal  Sj^(t)  determine  the 
number  of  signals  which  are  a  distance  2  from  itj  then 


//  = 


rl 


/V; 


For  M>8tate  CPSKS^  it  is  ascertained  with  the  help  of  Fig.  2  that 


/j,  =  /IFiv 


TT 


(T 

and  if  M  >  2 

N 


{N^ 

2 


and,  therefore. 


(£ rror)  = 


For  M  •  2,  r^  ■  y^2  W  E  and  N  •  1,  in  which  case 


in 


agreement  with  the  exact  solution  previously  obtained. 


(U) 


6 


(<) 

Error  curves  for  M-state  CPSKS  have  been  obtained  by  Cahn  •  The 
data  summarized  in  the  following  table  was  computed  from  the  approximate 
formula  derived  in  this  report.  If  these  data  are  plotted  on  Fig.  3  of 
Ref.  (5),  good  agreement  with  Cahn's  result  is  obtained. 


P  (Error] 


JL 


P(E)  «  10"^ 

P(JS)  -  10"^ 

P(E)  -  10"^ 

M 

E/Nq  (db) 

eAI(j  (db) 

eA(,  (db) 

k 

8.2 

10.3 

11.8 

8 

13.6 

15.7 

17.1 

16 

19.lt 

21.5 

23.0 

32 

25  .it 

27.5 

29.0 

Consideration  of  multiple  signal  alphabets  sooner  or  later  leads  to 
the  problem  of  how  to  compare  signal  alphabets.  Gilbert^ does  this  in 
an  interesting  manner  on  the  basis  of  efficiency  in  approaching  theoretical 
channel  capacity.  Assume  that  the  channel  is  to  be  used  to  transmit  decimal 
numbers  of  L  digits  in  length  (e.g.  map  coordinates).  If  an  alphabet  of  H 
symbols  (letters)  is  used)  let  x  denote  the  number  of  letters  required  to 
represent  the  L  place  decimal  nmber.  Since 

10^  - 


^For  M  ■  It,  the  approxim.'^ -.o  formula  gives  the  first  term  of  the  exact 
expression,  i.e.,  2a  ii 

P( Error)  =  a.^~  whertf  a.  =  (  f  -  ) 

is  the  probability  of  er  •  in  a  subchannel.  The  exact  expression  may  be 

derived  by  considering  ■  ii-state  case  to  consist  of  two  independent  binary 
subchannels  in  quadrat'  ,  each  with  energy  E/2. 
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one  has 


M 

If  it  is  required  that  only  one  niaaber  in  10^  be  received  incorrectly,  then 
the  average  letter  error  probability  must  satisfy 

/  -  (l-p)*  ^  Xp  S,  10-* 
or 

i0‘*  -iooff.  M 


From  the  approximate  foraula  for  the  average  error  probability  per  symbol 

r  "" 

the  value  of  may  be  detexnined  onoe  the  signal  alphabet  baa  been  apeoi- 
fied<  It  ia  convenient  to  Imagine  at  this  point  that  distanoes  have  been 
scaled  so  that  2  r^  •  1  so  that  the  latter  calculation  effectively  detemlnes 
ff  *  The  average  signal  power  is  given  by 


^  •  JfW  ^  ‘dim  ^ 


where  nov  is  the  distance  of  the  1^''  signal  point  from  the  origin.  The  ratio 


is  the  smallest  slgnal>to>nolse  power  ratio  that  meets  the  error  requirements. 
Recalling  that  0  *  2  T  V  and  since  logjM  bits  of  information  are  transmitted 
in  an  Intexral  T  •  o/2W,  one  has  for  the  rate  at  which  information  is  received 
(since  the  error  probability  ia  low) 


L/ZW 


D 
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Consequently,  a  given  signal  alphabet  may  be  plotted  as  a  point  (Y,  R/W) 
and  its  distance  above  the  theoretical  curve 

R/W  -  ioQt  (1  V 

may  be  taken  as  a  measure  of  the  efficiency  with  yhioh  the  given  signal 
alphabet  utilizes  channel  capacity* 

The  results  of  the  calculations  Indicated  above  for  M-state  CPSK  with 
p  -  10*^  for  a  10-digit  decimal  number  are  plotted  in  Fig*  3  and  labeled 
(HOPSK).  It  is  to  be  noted  that  2-atate  CPSK  la  the  most  efficient.  However, 
effidienoy  may  not  neoessarily  be  the  criterion  by  which  the  signal  alphabet 
should  be  chosen*  A  less  efficient  alphabet  yielding  a  higher  information 
rata  may  be  preferred  in  a  particular  situation*  If  this  oompromise  is  made, 
it  is  still  disturbing  to  know  that  the  minimum  signal-to-noise  power  ratio 
required  by  the  leas  efficient  alphabet  night  be  utilized  more  efficiently  to 
obtain  an  even  higher  information  rate*  The  search  for  efficient  signal 
alphabets  is,  therefore,  a  pnblem  of  practical  iir^ortance* 

A  more  efficient  set  of  signals  for  M  ■  8  than  those  of  Fig*  2  is 
shown  in  Fig*  U,  It  plots  as  the  point  marked  □  on  the  efficiency  graph  of 
Fig.  3. 


It  was  previously  pointed  out  that  for  a  given  M  >  2,  it  is  not  known 
how  to  choose  the  signals  so  that  the  average  error  probability  using  a  masci- 
mum  likelihood  detector  is  the  minimum  possible*  Tuiln^^^  reports 
that  "Dr*  A.  7*  Balakrlshnan  *...  has  proved  the  following  long-standing 
conjecture  concerning  the  general  oase  of  H  equiprobable  signals.  If  the 
dimensionality  of  the  signal  space  (roughly  2  TW)  is  at  least  M-1,  then  the 
signals,  envisaged  as  points  in  signal  space,  should  be  placed  at  the  vertices 
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»  RATE  PER  UNIT  lANPWIDTN  IN  BITS 


Figure  3  PROBABILITY  IS  10“'^  THAT  AN  ERROR  IS  HADE  IN 
A  10  DI<}IT  OECIHAL  NUMBER 
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of  an  (M-1)  -  dimensional  regular  sinqjlex  (i.e.,  a  polyhedron,  each  vertex 
of  which  is  equally  distant  from  every  other  vertex)...."  If  one  considers 
the  case  for  M  “  li,  then  there  is  no  difficulty  In  picturing  the  optiman 
set  of  signals  in  3-(ilmen8ional  space.  These  were  also  considered  by 
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Figure  ^  AN  EFFICIENT  SET  OF  8  SIGNALS 


Gilbert  and  are  shown  in  Fig.  5  reproduced  from  Ref.  3 •  It  is  readily 
ascertained  that  N  ■  3>  and  since  in  the  scale  shown  2  r^  ■  1 
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and 
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consequently, 

P  ( Erroj') 


31 


An  average  per  letter  error  probability  of  .602  x  10"^  is  required  for 
a  U-letter  alphabet  in  order  to  achieve  an  error  probability  of  lO"^  per 


Figure  5  OPTIMUM  SIONALS  IN  THREE  DIMENSIONAL  SPACE  FOR  M  «  >1 

ten-plaee  decimal  number.  For  Ii-etate  CPSK,  this  Is  achieved  at  y|-  •  li.6U. 
For  this  same  value  ,  the  average  per  letter  error  probabilSty  of  the 

algnale  of  Fig*  $  is  ?052  x  10**^,  vhioh  la  more  than  a  factor  of  ten  lower. 
The  signals  of  Fig.  5  yield  the  point  marked  A  on  the  efflcienoy  graph  of 
Fig.  3.  It  will  be  observed  that,  for  the  points  plotted  (i.e.,  an  error 
probability  p  -  10~^  per  10  digit  decimal  number)  these  signals  are  Just 
about  as  efficient  as  the  (ItCSPSK).  This  obsei'vation  is  worthy  of  future  • 
investigation  I  in  the  meantime,  it  may  be  conjectured  that  as  far  as  channel 
utilization  is  concerned,  the  lower  error  probability  for  a  given  is 
nearly  balanced  by  the  increase  in  dimensionality  (i.e.,  bandwidth-time 
product)  of  these  signals. 
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1(d)  DETECT  MEMO"  NO.  7A 

Subject:  "Error  lYobabilities  for  Coherent  Pulsed  Phase-shift  Keyed 
Systems  (CPPSKS)  with  Prequency  and  Sampling,  Time  Errors." 

By:  Eupene  A.  Trabka 

SUMMARY 

The  performance  of  two  embodiments  of  the  maximum  likelihood  receiver 
for  CPPSK  sif^nala  is  investigated  when  the  transmitted  signals  are  subject  to 
a  frequency  shift  and  the  times  at  which  the  receiver  outputs  are  sampled  are 
in  error.  Expressions  for  the  error  probability  are  derived.  It  is  found 
that  in  the  presence  of  sampling  time  errors  the  "practical  "  receiver  is  to 
be  preferred  over  the  matched-filter  receiver.  It  is  shown  how  the  "practical" 
receiver  can  be  realized  by  so-called  "integrate  and  dump"  techniques. 

INTRODUCTION 

It  was  shown  in  Reference  1  that  the  "practical"  receiver  of  Figure  1 
was  "equivalent"  to  the  matched  filter  embodiment  of  the  maximum  likelihood 
receiver  (Figure  2).  This  equivalence  was  establ'shed  assuming  that  the 
pliysical  components  in  eacli  case  were  perfect  and  did  not  introduce  errors. 
However,  it  is  of  interest  to  consider  whether  or  not  one  of  these  receivers 
is  superior  in  the  respect  that  it  is  less  sensitive  to  equipment  errors.  Two 
types  of  errors  readily  come  to  mind,  via.,  frequency  errors  and  sampling  time 
errors.  (See  Chapter  II  of  this  report  for  a  discussion  of  the  physical  cir¬ 
cumstances  under  which  this  analysis  is  applicable.) 

The  receiver  input,  y(t),  is  assumed  to  consist  of  the  sum  of  the 
signal,  s(t),  and  additive  white  Gaussian  noise,  n(t),  having  a  single-sided 
power  spectral  density  of  watts/cps,  i.e., 

lj(t}  ^  A,(t)  +  n(t)  (1) 


This  is  a  revision  of  DETE;!  MEMO  NO.  7  which  was  originally  issued 
21  November  I960. 
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Figure  2  MATCHED  FILTER  EMBODIHbNT  OF  MAXIMUM  LIKELIHOOD  RECEIVER 
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In  order  to  describe  the  signal,  s(t),  it  is  convenient  to  consider  time  to  be 
divided  into  intervals  having  a  duration  (  rat.'. on  of  an  olomentary  signal 
waveform).  Introducing  the  unit  rectangle  function 


uCO 


o<  i  &  1 
i  <0,  £>t 


(2) 


the  received  CPSK  signal  is  assumed  to  be 


where  the  transmitted  information  corresponds  to  the  phase  0^  and  the 
are  assumed  to  be  independently  distributed  from  one  interval  to  the  next. 
During  the  k-th  interval,  0^  may  assume  any  one  of  the  m  values*-^^(4-^^ 
where  i  ■  1,  2,  ....,  m  with  probability  i  .  The  angular  frequency  e rror 
iiou  ia  assumed  to  be  independent  of  k. 

PRACTICAL  RECEIVER 

The  filter  in  Figure  1  is  assumed  to  be  matched  to  zero  transmitted 
phase  (i  >1)  at  the  frequency  AJq  so  that  its  response  to  a  unit  impulse 
occurring  at  t  ■  0  is  given  by 


(h) 


and  the  filter  output  in  response  to  y(t)  is  given  by 


^  OO 

f y(r)/i,(e-T)  dr  (5) 

_ _  • 

The  subscripts  on  ^  in  Figure  1  are  used  to  note  those  m  values  that  may 
be  assumed  during  a  particular  baud  interval.  However,  in  the  analysis  to 
follow,  is  a  random  variable  designating  the  transmitted  phase  in  the 

k-th  interval. 
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which  from  (l)  nay  be  deoonpoeed  Into 


o,(.t)  *  n,(t) 


where 


^(T)h,  (i-r) 

-  OO 
♦  06 

fi(r)  h,  (t-r)  df 


The  variance  O”*  of  n^(t)  is  readily  shown  to  be 


or  - 


and  expressing  q^(t}  in  the  form 


1,  M  •  ^(t)  eo*  *  y^C*)] 


the  amplitude  R(t)  and  phase  fK(t)  are  evaluated  in  Appendix  B.  IVom  (6)  and 
(9)j  one  has 


Of  (t)  ’^K(t)  eos  [ot>g  t  *  A/t) 


and  (10)  may  be  expressed  in  the  form 


0,(t)»  V{t)  eos^Cii^t  +  (^^(^)J 


-  Ii  - 


3  January  1961 
DETECT  KEMD  NO.  7A 
AF  30(602)-2210 


It  is  recalled  that  for  the  case  when  y'(t)  ■  0,  it  was  shcfwn  in  Reference  2 
that  the  distribution  of  ^  Is  given  by 


,  |j<*|  4  „ 

d 


(12) 


where 


X 


■^20-^ 


(13) 


The  effect  of  y>  {t)i>  0  ia  to  shift  the  mean  of  the  diatribution  of  0*  and 
writing 


1^(0  -  j 

00  ■>' 

(14) 

the  probability  of  error  in  an 

m-state  system  is  given  by 

(15) 

-  Tt* 

t¥9 

where  the  density  ^  [  3  is  given  by  (12).  (In  Equation  (15)»  the  time 
dependence  of  £ (t)  has  been  suppressed  for  convenience  and  the  decision  rule 
is  apparent  from  the  limits  of  integration.)  Letting 


a  -  vo  cos  ^ 
/TA  «  >«  sLn  ^ 


(16) 
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3  January 

DETECT  MEMO  NO.  7j\ 
AF  30(602) -2210 


one  obtains 


-  oos  6  ♦  A-s£y7e+  Af']  I 


dv 


(17) 


For  jn  •  2,  (17)  is  readily  evaluated  by  completing  the  square  in  the  ejcponent 
atxi  yields 


PCz)  -  ^  er/*  C" X  de*  e;]  (18) 

where  X  and  €  are  to  be  evaluated  at  the  sampling  time  t  ■  T  +  AT.  In 
tenns  of  the  nondlmensional  paransters  defined  in  Appendix  B,  via.j 


at  - 

JQ  -  _^T 


(19) 


and  from  (8),  (13),  (lU),  (IS),  (B13)  or  (Bll*)  one  obtains  if  >(?-  0  and 


\sin  2  Trtc 

ZTT'C 


(20) 


and  if  oc  -  0  and 


(21) 
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where  (21)  is  also  obtained  If  only  first  order  terms  in  the  series  expansion 
of  P(2)  are  retained  for  small  and  1/8 1  . 

MATCHED  FILTER  RECEIVER  (m  «■  2) 

For  m  ■  2  the  matched  filter  receiver  of  Figure  2  utilizes  two  filters 
with  impulse  responses  to  a  unit  impulse  occurring  at  t  >  0  glwn  by 


h,  A  u.  sin  (  r-c)j 
(t) 


(22) 


Consequently,  for  their  respective  outputs  in  response  to  y(t)  one  has 


Ox  (t)  -  -O,  (i) 


(23) 


where  from  (6) 


(21*) 

and  assuming  zero  transmitted  phase  in  the  interval  0  i  t  <  T,  the  proba¬ 
bility  of  error  is  given  by 

/»{Z)  -  /^c6  ^  O*  j.  -  Pnai,  ^O,  <.  (25) 


Since  0^^  is  Gaussian  with  mean  given  by  (9)  and  C  given  by  (8),  it  is 
easily  shown  that 


^ f  -  enf 


(26) 
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where  is  to  be  evaluated  at  the  sampling  time  t  ■  T  + A  T .  Assuming  that 
A*#  T  -  2  7l'*(an  integer),  one  obtains  from  (8),  (9),  (26),  (D13)  or  (Blh)  if 
^  "  0  and  I  oA  I  <  •! 

m f  -f^}]  (27) 

which  is  seen  to  be  identical  with  the  error  probability  (20)  obtained  for  the 
"practical*  receiver  under  these  conditions.  If  ac  -  0  and 

•  GO*  Z  TV  (28) 

where  J-'  ”  and  is  the  frequency  corresponding  to  so  that 

(28)  is  seen  to  differ  from  the  error  probability  (21)  obtained  for  the 
"practical"  receiver  under  these  conditions. 

If  only  first-order  terms  of  the  series  expansion  of  (26)  are  retained 
for  small  foe/  and  fjij  ,  one  obtains 

=r  CO*  (x  It' A  71“)  (29) 

»  ( /-zfjSf)  aos  (z  ft"/ i-ec  TT) 

which  is  also  seen  to  differ  from  the  error  probability  (21)  obtained  for  the 
"practical"  receiver. 


-  8  - 
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PRACTICAL  7S.  MATCHED  FILTER  RSCSITER 

Comparing  (2?)  with  (20),  (28)  with  (21),  and  (2?)  with  (21),  it  is  found 
that  the  two  receivers  are  equivalent  if  A  T  •  0,  but  if  A  T  ^  0,  they  are 
equivalent  only  for  a  set  of  measure  zero,  namely,  those  values  of  A  T  for 
which  (A  T)  -  y  ”  an  integer.  Because  of  the  rapid  variation  of  the  error 
probability  of  the  matched  filter  receiver  in  the  presence  of  sampling  time 
errors,  the'praotioal  receiver  is  to  be  preferred.  That  the  sensitivity  of 
these  receivers  to  timing  errors  differs  is  also  apparent  from  a  phasor  diagram 
representation  of  their  operation. 

realization  of  PRACTICAL  RECEIVER 

The 'practical  receiver* is  easily  realized  by  integrate  and  dump  techniques 
which  employ  linear  time-varying  filters.  The  box  labeled  "M.F.  to  A  sin  t" 
in  Figure  1  may  be  replaced  by  the  lossless  parallel  L.C.  circuit  and  switches 
of  Figure  3<  In  this  Figure,  ^  and  y  denote  an  initial  current  and  an 
initial  voltage  respectively. 


Figure  3 

Integrate  and  Dump  Filter 

-  9  - 
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The  circuit  equations  are 


t  ^  if  i-  in, 


e 


(30) 


which  have  Laplace  transfoms 


•S'  ^ 

i  •  i,  *■ 


^  I 

a  •  Lm 


■f 

t. 


V» 


(31) 


and  solving  for  S  one  obtains 


•  — 


(32) 


where  LC  is  chosen  such  that  (a>o*-  ■ 


1 

I?  • 


If  at  t“0,  ^■^'■0  then 


^  +  O;,* 


0\ 

% 

c 


(33). 


and  the  response  to  a  unit  impulse  occurring  at  t  ■  0  (taking  account  of  the 
operation  of  the  switches  in  Figure  3 )  is 

/>(&)“  A  cos  Ct>^t  (3ij) 
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where  C  has  been  chosen  such  that  A  ^  .  Now,  the  filter  matched  to  A  sinA'at 
has  impulse  response 


h,  (t)  -  u(^)  A  sin  <5u*o  ('T'-t)  (35) 

so  that  (3U)  and  (35)  are  identical  if  T  ^  ^  Zlt*  where  k  is  any  inte¬ 

ger.  If  this  is  not  the  case,  the  difference  between  (3li)  and  (35)  results 
only  in  a  phase  ^ift  as  will  be  shown.  Using  complex  notation  as  in  Appendix 
B  (see  Bl),  one  finds  for  the  respective  complex  modulation  functions  that 

(36) 

so  that  the  outputs  differ  only  by  a  constant  phase  angle  which  may 

be  biased  out. in  the  measurement  process. 

The  measurement  of  the  phase  of  the  output  of  the  matched  filter  of  the 
receiver  in  Figure  3  is  to  be  performed  near  t  ■  T.  If  y? 'KU 

so  that  each  signal  interval  contains  many  cycles,  then  a  phase  detector 
which  performs  a  phase  measurement  during  an  interval  not  exceeding  one 
cycle  is  satisfactory.  Such  a  phase  measurement  may,  for  Instance,  be 
obtained  from  a  measurement  of  the  time  delay  between  a  positive  zero  crossing 
of  a  reference  (zero  phase)  signal  and  the  next  positive  zero  crossing  of  the  ^ 
output  of  the  matched  filter. 


-  11  - 
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APPENDIX  A 

Complex  Notation  for  the  Output  of  a  Linear  Filter 

The  purpose  of  this  Appendix  Is  to  introduce  the  representation  of  real 
signals  by  ccnplex  functions  of  tijas.  For  a  more  detailed  account|  including 
proofs  of  the  results  which  are  here  only  stated,  the  interested  reader  is 
urged  to  consult  the  excellent  Appendices  of  Reference  3* 

Let  U(f)  be  the  Fourier  Transform  (spectrum)  of  a  real  function  u.(t)  . 

If  one  considers  an  operation  which  shifts  the  spectrum  by  an  amount 
yielding  4/^^ ,  then  it  is  a  simple  exercisa  to  show  that  the  time  function 
corresponding  to  the  shifted  spectrum  is  given  by  which 

is  a  complex  function  of  time.  Thus,  if  one  tries  to  es^loit  this  simple  trans¬ 
formation  rule,  one  Is  ultimately  led  to  consider  complex  signals.  One  may  as 
well  introduce  complex  signals  at  the  outset.  By  writing 

('O  }  (Al) 

where 

ttc  (i  (t)  (A2) 

and  choosing  the  imaginary  part  ti(t)  to  be  the  Hilbert  Transform  of  a(t)^ 
the  spectrum  of  the  complex  signal  is,  the  same  as  that  which  would  be  obtained 
by  suppressing  the  negative  frequencies  of  i/(f)  and  doubling  the  magnitudes 
of  the  positive  ones. 

Now,  if  a  real  signal,  s(t),  is  the  input  to  a  linear  filter  with  im¬ 
pulse  response  h(t),  then  it  is  well  known  that  the  output  of  the  filter,  q(t), 
is  given  by 
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It  can  be  shown  that  in  terms  of  the  corresponding  complex  signals »  the  analo¬ 
gous  relationship  Is 


-  00 


(Ali) 


If  a(t)  and  h(t)  are  narrcm  band  time  functions,  It  Is  customary  to  write* 

where  5(t)  and  H(t)  are  low-pass  modulation  functions  (not  necessarily  real) 

and  Is  taken  to  be  the  carrier  of  8(t)  and  ,  the  center  frequency  of 

the  filter.  Substituting  (AS)  into  (Ait),  it  is  possible  to  eaqprese  q„(t)  in 

c 

the  form 


(A6) 


where  the  modulation  Q(t)  of  the  output  is  given  by 


^90 


■  00 


(A7) 


^Recall  that  e^*  ■  cos  x  +  i  sin  X  and  it  can  be  shown  that  the  Hilbert 
^ansform  of  cos  X  is  sin  %  . 
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and  the  magnitude  (amplitude)  and  argument  (phase)  of  Q(t)  considered  as  a 
complex  number  are  ordlmrlly  the  desired  quantities. 

A  particular  case  of  Interest  arises  when  •  6tJo  *  and 

^  *  Under  these  olrcumatanoes 
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APPENDIX  B 

Dttamlnation  of  the  Anplitude  and  Ruia«  of  Filter  Output 

The  empUtade  R(t)  and  phase  ^(t)  in  (9)  are  reapeotlvely  the  magnitude 
and  argument  of  the  coonplex  modulation  function  Q^^Ct)  as  described  in  Appendix  A. 
Writing 


Aj  (t)  •  ^ 


(Bl) 


where 


(B2) 

set)  -  j2  ‘  f  ] 


/*-00 


then  from  (AS)  one  has 


r 

.-‘"•y.  eHA-*’-  (B3) 

If-  T 


Expanding  (B3)  at  t  ■  T  +  id  T  under  the  restriction  that  |at|  ^  T^one 


I 
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obtains 


n-AT 


(Bl) 
if  ^T  £  d 


and 


Cir 


(  A 


dx 


r*Ar 

y  J 


(B5) 

if  ATi  0 


In  order  to  simplify  the  e;)qpressions  (Bli)  and  (B5),  it  is  convenient  to  assume 
that  (Vo  T  ■  2  'it'fo'i  ■  2  n  where  n  is  a  positive  integer.  Letting  E  ■  ^  A^T 
and 


where  ^<w=  2'!t:'Ap  ,  then 


(B6) 


a  (r^AT).  e  e‘«'’  1^/.  Wy  + 

o 

^  i(0.>-0^)  .izn'cc  r  iz  Tt^oct/ 


e  /  e 

7^ 


‘^i/T  ; 


(B7) 

if  JS&O 
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and 


Q,(rt-Ar)» 


r 


ii-A 


e  ‘  ^£»7rcc  fiz  itr»y  ^ 


(B8) 
if  J5  to 


where  ^  T  has  been  restricted  so  that  \jS\^i  .  Performing  the  Indicated 
integrations  for  binary  systems  (  ^  -  0  or  ft*),  one  finds 


(B9) 


depends  on  whether  or  not  there  is  a  phase  change  between  ad¬ 
jacent  intervals.  It  is  found  that 


no  phase  change 


(oi-iA)-  - - 


(BIO) 


phase  change  and  A  ^  ^ 


Z(cL,fi)MJjt±. - ^ 

^<a^pc_  f  phase  change  and  A  —  ^ 


For  both  «<•  and  A  near  zero,  expansion  of  Z (ex.  letting 

/+iz.  (Bil) 
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yields  in  the  case  of  a  phase  change 


(B12) 


which  la  also  an  exact  result  when  ec  ■  0  as  aay  be  ascertained  directly  from 
(B7)  and  (B8}.  Therefore,  for  et  and  >8  anffioient]jr  small,  retaining  only 
first-order  terms  yields 

m  *  ot,ir 


(e 


^(r4-AT)-\ 


l£(r-»  \a\') 


no  phase  change 

(B13) 


phase  change 


The  above  expressions  are  exact  when  at*  e  and  \A\^\ 
|ot|^  ^  the  exact  expreailona  are 

(r-t-AT)  m 


Afr’hAT')  -  e 


oc  ft' 
0C  ft' 


Whan  yd*  0  aiid 


(Bill) 
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1(e)  DErrECT  MEMO  NO.  8a 

Subject:  "Error  Probability  in  a  Binary  Coherent  Pulsed  Phase  Shift 

Keyed  System  (BCPPSKS)  with  Crosstalk  from  Adjacent  Multiplexed 
Channels" 

By:  Eugene  A.  Trabka 

SUMEDUg 

The  error  probability  in  a  BCPPSKS  channel  is  derived  in  the  presence 
of  crosstalk  from  adjacent  frequency  multiplexed  channels.  The  crosstalk  is 
considered  to  arise  from  a  frequency  error  of  the  reoelved  signals*  Error 
probability  curves  are  plotted  in  Figure  2  for  various  values  of  frequency 
error. 

INTRODUCTION 

Assume  that  in  a  BCPPSKS  the  signals  that  it  is  desired  to  transmit 
are  given  by 

M  =  ^(^)  ^  ^  ^  (4]  ( 

where  ^  ^  is  equal  to  0  or  7i  each  with  probability  ^  and  u  (^)  is  the 
unit  rectangle  function  defined  to  be  1  for  0  £  t  <1  T,  and  zero  elsevrtiere. 
Let  the  decision  as  to  which  signal  was  actually  transmitted  be  made  by  the 
practical  embodiment  of  the  maximum  likelihood  receiver  as  shown  in  Figure  1, 
(The  conditions  under  which  the  performance  of  this  receiver  is  equivalent 
to  the  matched  filter  embodiment  of  the  maximum  likelihood  receiver  were 
analyzed  in  References  1  and  2.)  Tt  is  well  known  that  several  such  channels 
may  be  frequency-multiplexed  without  impairing  the  theoretical  performance 
of  the  individual  unimiltipl exed  channels  provided  that  the  separation  of 
their  carrier  frequencies  is  an  integral  multiple  of  i  •  Tld.s  result  follows 

■-"This  is  a  revision  of  DCTRCT  MEMO  WO.  8  which  was  originally  issued 
30  November  I960. 
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from  the  fact  that  the  croaetaUc  (eoaponent  of  the  filter  output  in  a  par¬ 
ticular  channel  due  to  the  aignal  in  another  channel)  la  sero  at  the  proper 
sampling  time.  Oie  purpose  of  the  present  analysis  is  to  detarmins  the  ef¬ 
fect  on  a  particular  channel  of  the  crosstalk  at  the  proper  sampling  time 
caused  by  a  frequency  error  in  the  incoming  signal. 


( 


Figure  I  A  "PRACTICAL*^  RECEIVER 

Three  channels  indexed  by  k  are  considered  so  that  the  input  to  the 
receiver,  y(t),  during  one  signal  interval  is  given  by 


yCt)»  n(t) 


X  •  -/ 


A  sirt 


(2) 


where  n(t)  is  a  member  of  an  ensemble  of  white  Oaussian  noise  with  spectral 
density  watts/cps.  It  will  further  be  assumed  that 


x,n' 

Z.7P 


■i 


-  2  - 


(3)  ^ 


3  January  1961 
DETECT  MEMO  HO.  6A 
AE  30(602) -2210 


and  letting  •  2  iCAf  ,  the  frequency  error  Af*  la  aeaaured  in  fractions 
of  Tla. 

Af  ik) 

The  transmitted  phases  are  assumed  to  be  Independent  random  varlablea.*' 

The  error  probability  of  the  zeroth  channel  whose  receiving  filter  haa  Im¬ 
pulse  response 


A  sih  (T~t)  (5) 

will  be  derived. 


CRQSaTALK  DETERMINATION 

Decomposing  the  output  of  the  filter  defined  by  (5)  into  a  signal  and 
noise  component  one  has 

OC*)  ^  foC*)  9 


and  writing 


+  to 

(t)  (t-x)  dx 

- 

+  00 

(t)  (X)  ^9  (^-X)  d.X 

-  00 

<^o  (t)  =  RC&)  affs 


(6) 


(7) 


The  subscripts  on  ^  In  Figure  1  are  used  to  note  those  permissible 
values  of  phase  that  may  be  assumed  in  a  particular  channel  during  a 
given  baud  interval.  However,  in  the  analysis  which  follows  ^  k  is 
a  random  variable  designating  the  transmitted  phase  in  the  k-th  channel. 
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the  aaplitude  B(T)  and  phase  ^  (T)  at  t  ■  T  aay  be  detenlned  (aa  ahoim  In 
i^pendlx  J.  of  Referenee  2)  as  reapeotlvely  the  nagnltude  and  argunent  of 


where 


(9) 


and  froat  (2),  (3}f  and  (5)  it  can  be  detemlaad  that 


S(i) -/1a('f) e ' J 

(10) 


Substitut'iJig  (10)  Into  (8),  changing  liie  Tariable  of  integration  aeeordii^ 
to  ^  ■  Ty,  and  lotting  E  -  ^  T  yields 

I 

(11) 
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where  -  0o  »“*  "  0i  “  ^o*  integra¬ 

tion  indloated  in  (11)  one  obtains 


J 

Since  the  only  permissible  Talues  of  end  are  0^  -•■  ^aad  -  Ti', 

the  second  term  in  £  J  is  real  so  that 


"  A  ■*’  7- 


(13) 


and 


where  ^  ^  assumes  the  values,  each  with  probability  ^  > 


(15) 


Examining  (13)  it  is  found  that  the  effect  of  the  frequency  error  is  to 
Introduce  an  error 


€  o(.7r 


(16) 
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into  the  phase  raeasurenient  (the  term  being  a  constant  Independent  of 

transmitted  phase  may  be  biased  out).  Under  these  circumstances  it  was  shown 
in  Reference  2  that  the  probability  of  error  is  given  by 


r- 


( R.  cos  6 


)] 


(17) 


where 


(18) 


and  <r  the  variance  of  np(t)  as  given  by  (6)  is 

or  = 


(19) 


Consequently!  the  total  error  probability  is  given  by 


where  the  are  given  by  (15). 

RESULTS 

The  error  probabilities  considered  as  functions  of  E/N^  are  plotted 
as  the  solid  curves  in  Figure  2  for  ot-  o,  .1,  ,2,  .3j  .li  and  .5.  The  dashed 
curves  are  the  error  probabilities  that  would  result  from  corresponding  fre¬ 
quency  errors  in  the  absence  of  the  two  adjacent  multiplexed  channels  and 
vrere  plotted  from  Equation  (27)  of  Reference  2  . 
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Figure  2  ERROR  PROBABILITY  OF  A  BCPPSKS  WITH  FREQUENCY  ERROR 
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1(f)  DETECT  MEMO  NO.  10 

Subject:  (a)  "Double  Bit  Matched  Filter  (DBMF)  Reception  of 

Differentially  Coherent  Binary  Riase  Shift  Keyed 
(DCBPSK)  Signals." 

(b)  "The  Equivalence  of  Integrate,  Delay  and  Ihase 

Comparison  and  DBMF  Receivers  for  DCBPSK  Systems." 

By;  John  G.  I^iwton 


SUMMARY 

A  new  receiver  concept  for  the  reception  of  Differentially  Coherent 
Binary  Phase  Shift  Keyed  signals  is  described.  The  operation  of  this  re¬ 
ceiver,  called  a  Double  Bit  Matched  Filter  (DBMF)  receiver,  is  compared 
with  that  of  the  Integrate,  Delay  and  Phase  Comparison  receiver,  which  has 
been  previously  analyzed. It  is  shown  that  the  theoretical  operation  of 
both  receivers  is  described  by  the  same  mathematical  expression.  It  follows 
that  these  receivers  will  theoretically  make  identical  decisions  for  all  in¬ 
puts  and  synchronization  errors.  The  question  as  to  which  receiver  is  to  be 
preferred  in  practice  cannot  be  decided  on  theoretical  grounds.  Some  of  the 
sources  for  differences  in  performance  between  the  above  ideal  receivers  and 
practical  receivers  of  the  Integrate,  Hold  and  D’imp  variety  are  pointed  out. 


DISCUSSION 

The  probability  of  error  of  a  D(<BPSK  system  operating  in  the  presence 
of  additive  white  Gaussian  noise  is  given  in  Kef.  (1)  as 


Pe  = 

or.Hpix 


1 

~2 


(la) 


vhlle  that  of  a  nonooherent  blurj  FSK  system  is  glyen  as 


FSfC 


J_ 

2 


No 


(lb) 


where  B  ...  Signal  energy  per  received  bit, 

No...  Noise  power  density  per  cycle/see.  of  one-sided  speotrom. 

Examination  of  the  derivation  of  Equation  (lb)  in  Reference  (1)  shows 
that  while  the  analysis  was  perf armed  with  noncoherent  FSK  signals  in  Blind, 
the  analysis  is  not  restricted  to  that  particular  form  of  modulation*  Ihe 
analysis  can,  in  fact,  be  easily  extended  to  Include  all  noncoherent  binary 
systems  tdiich  use  orthogonal  (/7»C!)  signals  of  equal  energy.  The  question 
then  arose  whether  the  similarity  of  Equations  (la)  and  (lb)  could  be  ex¬ 
plained  on  this  basis.  This  was  found  to  be  the  case  and  a  new  receiver  em¬ 
bodiment,  >diich  we  will  call  a  Double  Bit  Matched  Filter  (DBMF)  receiver, 
naturally  suggested  itself. 

The  purposes  of  this  memo  aret 

1)  To  describe  the  operation  of  the  DBMF  receiver. 

2)  To  explain  the  connection  between  Equations  (la)  and  (lb). 

3)  To  demonstrate  the  equivalence  of  the  DBMF  receiver,  the  Integrate, 
Delay  and  Ihase  Comparison  receiver  (which  is  based  directly  on  the 
theory  of  DCFSK  systems),  and  the  commonly  used  Integrate,  Hold  and 
Duitp  receivers. 

DBMF  RECEIVER 

Consider  the  waveforms  transmitted  during  an  interval  of  two-bit 
duration  by  a  DCBFSK  system.  There  are  two  sets  of  signals;  in  one,  the 
phase  of  the  second  bit  is  the  sane  as  that  of  the  first  bit,  and  in  the 
other  there  is  a  phase  reversal.  The  different  signals  within  each  set  can 
be  differentiated  only  os  the  basis  of  absolute  phase,  which  is  assuawd  not 
available  to  the  receiver.  The  receiver  must  decide  at  the  end  of  every 
bit  interval  to  which  set  the  signal  received  during  the  previous  two-hit 
intervals  belongs. 
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It  will  be  noted  that  ad;)acent  decisions,  which  are  mde  at  the  bit 
rate,  are  not  Ind^endent  since  the  two  signals  (each  ol*  two-bit  Intenral 
duration)  on  which  they  are  based  are  identical  over  a  ona-blt  intertal. 

The  four  possible  transmitted  signals  are  described  as 


S,(t)  = 


s:{t) 


sin  UJot  , 
0 


•  Sin  CL>ct 
0 


0  <  t  <  2T 
elsewhera 

0<t  <  2T 
elsewhere 


Mark  set 


sin  oOot  . 
-  -  sin  uj^t  , 
0 


0  <  t  <  T 
T  ^  t  <  ZT 
elsewhere 


s;  (t) 


-sin 
sin  (jO^t 
0 


0  <  t  <T 
T  S.  t  <  2T 
elsewhere 


Space  set 


(2) 


u>ot  =  2 TTn  where  «  is  an  integer. 

It  will  be  noted  that  all  signals  contain  equal  energy  and  that  tbs 
correlation  coefficient  of  any  signal  in  the  Hark  set  vith  any  signal  in 
the  Space  set  is  zero* 

In  Differentially  Coherent  systems  it  is  assum  - 1  that  the  possible 
received  signals  are  known  completely  at  the  receive*  xeept  for  phase; 
the  phase  is  assumed  a  priori  to  be  uniformly  distr}  -ed,  but  to  remain 
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fixed  over  adjacent  bite.  Under  these  assumptions,*  the  rocelred  signals  ■st' 
be  described  by 


S^(t) 


5s  (t) 


sin  (uJQt  +  } 

O 


0  <  t  <  2T 


sin  (cJUot  ^  yt)  ,  0  <  t  <■  T 
•  -  sin  ( u)gt  Ip)  ,  T  <  t  C  2T 


0 


elseivhene 


(3) 


where  ip  represents  the  tmknown  phase.  Now  S^('b)  and  S^(t)  have  all  the 
properties  required  by  the  derivation  of  Bquatlon  (lb)  carriad  oat  in 
Reference  (1).  Those  properties  are: 

(a)  Correlation  ooeffleient  p  ‘  0 

(b)  Equal  energy 

(e)  Unknown  phase  assaned  dlstrlbutad  unlfomly 

The  analysis  in  Reference  (1)  shows  that  a  reoelveir  (sketched  In 
Figure  1)  consisting  of  two  aatohed  filters,  envelope  detectors,  a  oonpara- 
tor  and  synchronisation  circuitry,  will  perform  in  aocordanes  with  Iqnation 
(lb)  in  the  presence  of  additive  white  Gaussian  noise,  where  the  «iergy  1 
must  now  be  taken  as  the  signal  energy  during  a  two-bit  interval  as  is  dis¬ 
cussed  in  the  next  paragraph. 


Although  it  is  not  the  purpose  of  the  current  memo  to  investigate  the 
validity  of  these  assumptions,  we  point  out  that  there  are  arguments  to 
Justify  these  assumptions  in  cases  of  praotioal  Interest.  Also  note  that 
no  claim  is  made  that  any  of  the  receivers  described  are  the  bast  receivers 
to  use  under  these  assumptions.  (For  instance,  the  assumption  that  the 
phase  remains  constant  over  adjacent  bits  clearly  implies  that  it  remains 
constant  for  all  time*  la  OCFSK  operation,  advantage  is  taken  only  of  the 
invariance  of  rhaae  over  adjacent  bite.  It  has  not  been  shown  that  these 
receivers  are  optimun.  However,  in  cases  where  the  phase  varies  slowly, 
the  approximation  of  constant  phase  over  adjacent  bits  may  be  reasonable, 
while  the  assumption  of  constant  phase  is  not.) 


i 
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Figure  1 

Block  Diagram  of  DBKF  Receiver 

THE  RBTJITION  OF  B3U1TI0N  (la)  to  TOUATION  (lb) 

In  the  derivation  of  Equations  (la)  and  (lb)  carried  through  in 
Reference  (l),  E  represents  the  signal  energy  per  received  bit.  As  has  al> 
ready  been  mentioned,  Equation  (lb)  which  was  derived  for  noncoherent  .(wide 
band)  FSK  holds  for  all  binary  systems  in  which 

(a)  the  correlation  coefficient  between  the  two  (sets  of)  signals  Is 
zero,  yO  =‘  0 

(b)  the  signals  have  equal  energy, 

(e)  the  phase  of  tbs  received  signal  is  unknown  and  (assumed)  distri¬ 
buted  uniformly, 

provided  that  E  is  interpreted  as  the  energy  per  received  signal*  In  the 
ease  of  wide  band  FSK,  it  happens  that  the  energy  per  bit  is  equal  to  the 
energy  per  orthogonal  signal  element.  In  th.  case  of  DCBFSE,  however,  two- 
bit  decisions  are  made  per  orthogonal  signal  element  of  duration  2T.  The 
energy  per  bit,  is  therefcre  one -half  of  the  energy  per  signal  E^. 

from  which  the  relationship  of  Eqn,  (la)  to  Eqn.  (lb) 

follows . 

Thus 


2Mo 


_J± 

No 


il) 
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THE  EQUIVALENCS  OF  DBMF  AND  INTEGRAIE,DELAY  AND  PHASJE  COMPARISON  RECEIVERS 

We  will  now  show  that  the  DBMF  receiver  and  the  Integrate/'OelAy  and 
Phase  Comparison  receiver  perfonn  in  formally  equivalent  waj^. 

Tbs  impulse  response  h^Ct)  of  the  filter  in  Figure  1,  aatobed 
to  the  Mark  set  of  signals  is  given  by 


h,(t}  - 


CjUq^  t 


0  <  e  <  2r 

alseivhere 


(Sa) 


and  the  istpulse  response  (t)  of  the  filter  aiatohed  to  the  Space  set 
of  signals  is  given  by 


(t) 


*  sin 

-  sin  COgt 
0 


0  <  t  <  T 
Tit  <27 
elsewhere 


(5b) 


We  now  define  a  fbnotlon  f (t)  in  terms  of  which  both  b^^Ct)  and  h2(t}  miy  be 
conveniently  eq^essed. 

Let 


f(t) 


then 


sin  UJgt  ,  0  <  t  <  7 


elsewhere 


h,  (i)  =  f(t)  +  f(i-T) 
h^ii)  =  Ht)  -  fit -7) 


(7) 


The  outputs  of  the  two  filters  in  response  to  an  arbitrary  input  l(t)  aire 
given  by 

it)  =  /  iir)  h,  (t  -  r)  dr 


fit-r-r)^  dv 


(8a) 
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aiKl 


eg(t)  -  /  i(r)  hj(t-T)  dr 


Zy.  oo 

i(r}  [f(i-r)  -  dr 


(8b) 


It  l8  alvaya  possible  to  find  fnnctioiia  iLj^(t),  ^it) ,  <f> -^{t) , 
A2(t)  i  0  such  that 


if  oa 


Ur)  f(t-r)  dr  -  cos  v- 


<9a) 


,  f-  «i« 


Ur)  f(t-T-r)dr  =  A^it)  cos  [tOot  f  0^  ft)] 


(9b) 


The  functions  A^(t),  A2(t),  uniquely  defined 

by  the  left-hand  side  of  (9a)  and  (9b),  If  the  process  is  narrow  baadi^  as 
it  will  be  in  practice,  then  A]^(t),  A2(t)  and  0  ^^(t),  0  2(*^  ®“  ^  ®®  chosen 
that  they  may  reasonably  be  described  as  the  envelope  and  phase  of  these  pro¬ 
cesses,  We  assume  that  this  is  the  case. 


The  envelope  detectors,  Figure  1,  produce  the  envelopes  B^(t),  B2(*^ 
of  the  filter  outputs  S^(t)  and 


£,{t)  = 

E^it)  = 


(t)  +  A  2  it)  +  2Ai(t)  A  jit)  cos[_(f>/(t)  -  0j(t)'J 
Afit)^  A\it)  -  ZA^it)  A^it)  cos  [0Ut)  -<02^]] 


'A 


(lOa) 

(ICfc) 


*  Note  that  narrow-bandednsss  is  not  a  requisite  for  the  formal  argument. 
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Ihe  decision  as  to  whether  a  signal  from  the  Haiic  or  Space  set  has  bean 
transmitted  is  made  by  comparing  E^(2T)  with  £2(21).  If  E^(2T)  >  £2(21), 
then  it  is  decided  that  a  Mark  has  been  sent  and  vice  yersa.  Since  Aj^(t)  and 
A2(t)  >  0  ,  it  is  apparent  from  (lOa)  and  (lOb)  that  E^(2T)  >  82(21) 

if  and  only  if  l^,(2rj  -  <Pj.(2T)  I  <  . 

We  will  now  show  that  the  Integrate,  Delay  and  Phase  Conparieon  re¬ 
ceiver  decides  that  a  signal  from  the  Hark  set  has  been  received  when  \(}>^  (2T) 
-  (})2(^T)\<  and  otherwise  decides  that  a  signal  from  the  space  set  has 
been  received.  It  is  seen  that  the  D6KF  and  the  Integrate,  Delay  and  Phase 
Con^arlson  receivers  will' make  identical  decisions  for  all  inputs  i(t). 

Note  that  since  these  receivers  make  identical  decisions  for  all  inputs  l(t) 
their  sensitivity  to  crosstalk  due  to  frequency  offset  or  synchronization 
errors  is  also  identical. 
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Figure  2 

Block  Diagram  of  Integrate, Delay  and  Phase  Comparison  Receiver 

Figure  2  is  a  block  diagram  of  the  Integrate,  Delay  and  Phase  Com¬ 
parison  Receiver.  The  receiver  contains  one  filter  having  impulse  response 

f sin  oOot  ,  0  <  t  <T  ,  ^ 

^(t)  =  \  (11) 

O  ,  elsewhere 

matched  to  the  signal  transmitted  during  one  bit  interval.  The  output  of 


-  8  - 


this  filter  at  point  is  applied  to  one  input  of  a  phase  comparator  and 
to  a  delay  circuit  having  a  delay  of  one -bit  duration  T.  The  output  of  the 
delay  circuit  point  is  applied  to  the  other  input  of  the  phase  compara¬ 
tor.  The  oonparator  aiakies  decisions  at  IntervalB  of  T  seconds «  as  controlled 
hy  the  synchronisation  circuit.  The  decisions  are  based  on  whether  the  phase 
difference  at  the  two  inputs  to  the  comparator  exceed  radians  in  absolute 
magnitude. 

The  output  of  the  filter  at  point  in  response  to  input  i(t) 


I(t)  =  /  Kt)  f(i-v)cLr 

Si  _  qO 

=  cos 


(12) 


and  the  output  of  the  delay  circuit  at  point  ^  is 


ir(t)  =  /  !(t)  dr 


=  A^it)  cos[ct>ot  + 


(13) 


The  decisions  are  made  on  the  basis  of  whether  or  not  -  0^  C^r)  |  Is 

greater  than  which  was  shown  to  be  the  criterion  for  the  DBMF  also. 

It  follows  that  if  the  performance  of  the  synchronization  circuits 
of  the  DBMF  and  the  Integrate,  Delay  and  Ihase  Comparison  receivers  are  iden¬ 
tical  the  two  receivers  will  make  identical  decisions  fcr  all  inputs. 


The  receivers  actually  used  for  the  reception  of  differentially  co¬ 
herent  signals  at  present  are  often  of  the  Integrate,  Hold  and  Dump  type.^^^ 
These  receivers  use  very  simple  filters,  ideally  a  single  lossless  resonant 
circuit,  the  impulse  response  of  which  is 


h(t) 


sin  cVot  t  0  <  t 


elsewhere  . 


(Hi) 
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Ihe  required  Impolae  response  (11)  is,  in  effect,  obtained  through 
the  operation  of  p(rop8rl7  STncfaronized  switohes  to  tezadmte  h(t)  as  given 
bjr  (lit).  The  delating  function  is  obtained  bj  diseonneoting  the  input  and 
letting  the  resonant  circuit  ring  at  its  natural  flrequencj.  A  pair  of  such 
filters  are  needed,  so  that  alternately  one  filter  can  be  conns cted  to  the 
input  (integrating)  while  the  other  delays  (holds)  the  aoouaiulated  phase  of 
the  preTious  bit  inteml.  The  stored  energy  which  is  used  to  "maeiher''  the 
prerious  phase  nust  be  discharged  (dumped)  before  the  signal  may  be  connected 
to  the  filter. 

Fran  an  analytic  point  of  view,  the  major  difference  between  the 
practical  Integrate,  Hold  and  Dump  (IHU))  receirer  and  the  theoretical  DBMF 
and  the  Integrate,  Delay  and  Fbase  CaiQ)arison  reeeiTers  is  that  the  latter  two 
require  only  one  input  from  the  synchronisation  circuits,  i.e.,  when  to  cem- 
para,  whereas  the  former  requires  several,  i.e.,  when  tb  consaot  and  discon¬ 
nect  the  signal  t'o  the  input  of  the  filters,  when  to  eoD^are,  and  when  to 
dump.  From  a  practical  point  of  view,  it  is  clear  that  none  of  these  opera¬ 
tions  can  be  performed  in  zero  time. 
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Subject:  "Error  Probabilities  of  Multiple -State  Differentially 
Coherent  Phase -shift  Keyed  Systems  in  the  Presence  of 
White ^  Oaussian  Noise." 

By:  John  T.  Fleck  and  Eugene  A.  Trabka 

SUMMARY 


The  character  error  probability  in  an  m-state  differentially  coherent 
phase-shift  keyed  system  (DCPSXS)  is  derived  and  plotted  for  various  values 
of  m  in  Figure  6.  The . subchannel  error  probability  in  a  U-state  differen¬ 
tially  coherent  phase-shift  keyed  system  is  plotted  in  Figure  9>  The  analysis 
from  which  these  cmrves  were  obtained  includes  formulae  of  more  general  in¬ 
terest  'relating  to  two  vectors  independently  perturbed  by  Oaussian  noiset  viz,, 

(a)  an  approximate  formula  for  the  probability  that  their  phase  difference 
(about  the  mean)  exceeds  a  specified  value  as  given  by  Equation  (60)  and 

(b)  a  tractable  Integral  expression  for  the  probability  that  their  dot  product 
is  negative  as  given  by  Equation  (137 )• 


# 


This  is  a  revision  of  DETECT  MEMO  NO.  2  which  was  originally  Issued 
2li  June  I960. 
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I.  INTRODUCTION 

A  digital  coBmunications  aystem  1ji  which  the  signal  alphabet  consists 
of  m  narrow  band  signals  which  differ  only  in  the  phases  of  the  carrier 
is  called  an  m-atate  phase-shift  keyed  system  (FSK) .  At  least  two  modes  of 
operating  phase-shift  keyed  systems  have  been  considered;  these  are  the 
coherent  and  the  differentially  coherent  modes.  With  coherent  phase-shift 
keying  the  infomation  to  be  transmitted  determines  the  phase  of  the  trans¬ 
mitted  signal  carrier  relative  to  an  absolute  reference;  it  follows  that  the 
receiver  must  also  have  access  to  an  absolute  phase  reference  in  order  to 
interpret  the  received  signals.  In  a  differentially  coherent  phase-shift 
keyed  system  (DCPSKS)  the  phase  of  the  previously  transmitted  signal  is 
used  as  the  reference  for  the  succeeding  signal;  the  receiver  uses  the 
phase  of  the  last  received  signal  as  a  reference  in  interpreting  the  current 
signal.  Although  the  error  rates  of  coherent  PSK  systems  are  theoretically 
lower  than  those  of  differentially  coherent  PSK  systems,  the  requirement 
for  absolute  phase  references  (i.e.  phase  lock  between  the  trani^tter  and 
receiver  references)  is  a  serious  disadvantage  in  practice.  The  error 
pTObabilities  of  binary  (n  ■  2)  DCPSKS  in  the  presence  of  white  Gaussian 
noise  were  obtained  in  Ref.  1.  The  present  memo  extends  that  analysis 
for  arbitrary  m.  The  coherent  PSK  mode  for  arbitrary  n  has  been 
analyied  by  C.  Cahn  in  Ref.  (2). 
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II.  MULTIPLE-STATE  DIFPERENTIALLY  COHERENT 
PHASE-SHIFT  KErED  SYSTEaiS  (DGPSKS) 

A .  Mathematical  Formiilatlon 


The  signals  (characters)  of  an  m-state  DGPSKS  are  shown  represented 
vectorially  In  Fig.  1  for  the  case  n  -  8.  The  reference  (preceding)  signal 
is  shown  pointing  vertically  upward  and  the  dotted  lines  represent  decision 
thresholds  for  the  detector. 


Figure  I 


A  block  diagram  which  illustrates  the  operation  of  the  receiving 
terminal  of  a  DGPSKS  to  be  analyzed  is  shown  in  iFlgure  2.  The  input  to 
the  matched  filter  consists  of  a  sequence  of  non-overlapping  pulsed  signals, 
each  of  duration  T,  and  the  accompanying  noise.  It  is  assumed  that  the 
noise  is  white,  Gaussian  and  has  a  single-sided  power  spectral  density  <.f 


u 


Figure  2 


M  vatta/ops  over  the  pass  band  of  the  filter  matched  to  the  signal.  It  is 
well  known,  e.g.  Ref.  1,  that  under  the  above  conditions  a  matched  filter# 
maxlmlees  the  ratio  at  Its  output  of  Instantaneous  signal  power  to  average 
noise  power  and  that  the  maximum  value  of  this  ratip  is  given  hy 

Max  J  It^stantaneoua  signal  power  |  .26 

1  average  noise  power  f  IT*  '  ' 

''output  ° 

where  E  Is  the  energy  of  the  Input  signal.  The  synchronizing  circuit  passes 
the  output  of  the  matched  filter  to  a  phase  detecto**  at  the  instant  when  the 
ratio  (1)  .  attains  its  maximum.  Let  denote  the  transmitted  phase  of  the 
l^h  signal  and  the  measvired  phase  corresponding  to  ,  The  measured  phase 
is  applied  to  one  input  of  the  comparator  and  to  a  delay  olroult.  The 
otlMr  input  to  the  comparator  is  the  measured  phase  of  the  previous 
signal  pulse.  The  output  of  the  comparator  is  the  difference  ^ 

After  a  delay  equal  to  a  pulse  period,  ,  becomes  available  from  the 
delay  circuit  for  use  as  a  reference  for  comparison  with  •  The 
probability^of  ^rror  P  (m)  is  then  the  probability  that  the  measured  phase 
difference  differs  by  more  than  7^/^  In  absolute  value  from  the 

phase  difference  of  the  transmitted  signals  fS-  -  0.  ^  . 


A  matched  filter  has  an  impulse  response  which  is  the  time  reversal  of  the 
signal.  The  entire  June  i960  issue  of  the  IRE  TRANSACTIONS  OF  THE  PGIT  is 
devoted  to  a  discussion  of  the  properties  and  applications  of  matched 
filters. 
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Let  h(  oL  )  denote  the  probability  density  about  the  mean  of  the 
measured  phase  difference  between  two  suecessiTe  received  signals  where 
-fT<  oc  <  i-  IT,  If  one  defines 


H(d}=‘  ~  J' ^  (<><■)  doc  -2:^ h  facj  d 


oc 


(2) 


then*  the  probability  of  a  character  error  is  given  by 

j  (3) 

B«  '  Diatrlbutlon  (About  the  Mean)  of  the  Phase 
'  Oif^arenoe  Between  Two  Vectors  of  squal  Length 
Independently  Perturbed  by  Oaussian  Noise 

The  output  of  the  matched  filter  in  Figure  due  to  a  particular 
input  signal  may  be  represented  by 

A{t)  ^oa  i- n  (t)  (U) 


where  the  time  origin  has  been  chosen  such  that  the  tranamltted  signal  has 
aero  phassi  A(t)  is  the  envelope  of  the  response  due  to  the  signal  component 
of  the  input,  angular  frequency  of  the  transmitted  signal,  and  n(t) 

is  a  member  of  an  enssnble  of  band-limited  Oaussian  notse  with  aero  mean  and 
total  average  power  e*  •  Substituting  into  (U),  the  band-limited  representation 

tJdd  sin  eJ^t 

where  n  ,  n  are  unoorrelated  Oaussian  random  variables  whose  Joint  distribu¬ 
tion  is  given  by 

^  (6) 


*The  intermediate  function  H  of  the  continuous  variable  9  is  introduced 
to  emphasize  that  ?p(B}  ia  a  apeolal  oaae  of  a  more  general  problem  to  which 
the  analyaia  given  m  thia  report  also  spplias. 
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one  obtains 


y  (r)  =•  .<.ns  --n^  Siti  cJ^t  (1 

Equation  (7)  may  also  be  written  in  the  form 

y  (t  I  ^  [/  <Oo  (  +  (p)  (e 

where  Vj  4>  are  respectively  the  envelope  and  phase  of  the  matched  filter 
output.  This  is  accomplished  by  means  of  the  substitution 


^<os<P  =  A  +n^ 
V  Ji'fi  ^ 


0  <  1/  <  ots 

-Tt:  <  -tTt 


From  (6) 4  taking  into  account  the  Jacobian  of  the  transformation  (9)>  one 
obtains  the  Joint  probability  density  of  V  and  ,  viz. 


^  hLn^ P  A,  V  <os  gi  -A) 


Transforming  the  variable  V  and  parameter  A  according  to 

1/  =»/0 

A  =5  jYs^ 

there  obtains  the  joint  probability  density 


JO  ^  -(jO^  —  2.0S 

n  ^ 


and  the  probability  density  of  0  may  be  obtained  by  it.r.  nvnr 

)  i  •  Gi  t 


P^[0)=  0  ; 


\p\>rc 
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Consider  the  phase  difference  oc  defined  by 


^  =  54  - 


(Ui) 


where  <(>^  and  ijj^are  the  phases  of  successive  receivad  signals,  and  may  be 
considered  to  be  independent,  each  with  a  probability  den|ity  given  by  (12). 
The  probability  density  of  oi  is  given  by  the  convolution 


•  0P 


(IS) 


and  taking  into  account  the  range  of  values  where  the  integral  in  (15) 
is  zero,  one  finds 


•  mtfi  [fe^Tt-oc] 
w**  C-rjTj-'W-ec] 

(oi.)^  0  ‘  lot)  >  27t 


Since  and oc^r^n: are  effectively  the  eaine  angle,  it  ie  convenient  to  intro¬ 
duce  the  density  h(  ol  )  where 

.  /  \  ,  s  /  \  f-/or  0S«S7C  1 

P,  («)  P,  I  (17 

h  (o^)  =  o  *  loci  >7r: 

Now,  considering  only  the  case v!*  when  sot  STT  ,  one  has 


ft -DC 

-re 

^It  is  assumed  without  loss  of  generality  that  zeico  phase  change 
has  been  transmitted. 

The  argument  is  similar  for  -7( ±  oc<  0 


(IB) 
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and 


f (p)  ^  -27C)  d,<f> 

7t-U 


and  for  0  i.  oi~  ■&  Tt  one  ma7  write 


«■-«  rc 

h  (ol}^J  .fy  {(p-hcC-kTt)  oL(p  ^20) 


In  Figure  3|  the  heavier  eeetlona  of  the  ourvaa  shown  represent  the  densities 
Pi.  (  ^  )  and  P  I, ( fli  +  <«• )  «>  funotloas  of  ^  for  the  oase  of  a  positive  oi  . 

The  lighter  seotlons  of  these  oiirves  represent  the  perlodlo  extensions 
of  the  respeotive  densities.  Reflecting  upon  Figure  3i  0Q«  that  if 


Figure  3 
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instead  of  (13)*  p*j^  {</>)  is  defined  as 
^  00 

p^' (^)  f  ^ 


(21) 


< 


then,  it  is  possible  to  eatress  h(ai)  as  given  by  (20)  as 

y.« 

The  expressions  (22)  and  (21)  are  as  yet  purely  formal.  Using  (22), 
(21)  and  (12)  gives 


(22) 


i-n 


oo  oo 


J  J>  -  -  -fyO^-^/sS  jCOSP*-i*-nf-?fS<C<$(p*et^*s1 

Cdjoj  dr  JOT  s'-  ^  '’^(23) 

-n.  o  ° 

and  the  integration  with  respect  to  ^  is  readily  performed  yielding 

d/)Jdrj3re  lj2S>^yo%f^^2/>r'  <os ot-j 


where  lAX)  Is  the  Bessel  function  of  order  zero  and  imaginary  argument. 
(See  Ap^ndix  A).  Making  the  substitutions 


u,  -^co^  j3  *  \  ('X./2) 

i  i  27 


2-6 


■r  =  (/  stn  y5 
yields 


^=0 


“  _r  ^ 

A  (ek  j  »  J*  oLAJ  du.  tJ  sin yi  ^cos  S  . 


E 


5^0,*^  [1  i-  -CoS  oL  Sir)  c/ay 
Hi  -A  \ 


(25) 


(26) 
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and  since 


U.  e  oCu 


U  +  1]\ 


(27) 


one  obtains  on  perfoxnixig  the  Integration  indicated  in  (26)  with  respect  to  w 

rr/a 

^  (“)-  -hi d.fi  m 

0  ^ 

Mowj  it  Is  easily  seen  that 

oo 


SJ  a  ^  (Z£^)  e' 


(29) 


so  that  (26)  nay  be  written  as 
Tt/s 


.  ir  r  »/  -)  -S  ot.jin2jh) 

/6  (o^  '  *  ~  J  .  Si.v  2/i.  \  l  +  €05  01.  sir)  2/5) of jQ  ^^O) 


or  letting 

f  2/3 
R 


(31) 


one  finally  obtains  from  the  symnetry  of  sin  'p  with  respect  to  TtiZ 

^70  -R(^l-€os  oc  sir,  y) 

h  (oi-)  =  J  Sir,  y  \j -f-  R(li-  €05  oi.  sin  y/)^6dy  (^2) 


where  fron  (31),  (11)  and  (1) 


1 

1 

.  E 

2 

(??/"  T 

(  /Va  / 

^0 

(33) 

so  that  the  parameter  R  in  (32)  is  ;)u8t  the  ratio  of  signal  energy  per  pulse 
to  the  input  noise  power  density. 
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From  (32),  it  is  obvious  that 

h  (-oi)  ~hio(.)  ( 

which  was  anticipated  intultatively  and  xised  to  si]i9>llfy  (2).  Moreover, 
since  hCex: )  is  a  probability  density,  it  must  satisfy 

+re 

^  h(u]ciai.  =  1  ^ 

-K 

This  relationship  may  be  verified  by  using  (32)  in  (35)  and  eiqpanding 
(35)  as  the  sum  of  two  integrals 


where 


.+Tt  .'K/2 

^  1  f  ,  [  ,  ^  oc  Sir)  w 

^  ^  dec  dp  jtn  p  £ 


-K  0 


+  ’>t  'Tt/Z 


H  -  doc  j  dp  SLl^^  P  Z0$ 


oc  £ 


e  -cfis  at  Sir)  p 


-Tt  0 


Performing  the  integration  with  respect  to  ac  first  in  (37)  gives 

J  =  I  Sen  P  ^  (Hi  Sir)  p)  dp  0 

*0 

and  using  again  the  series  representation  of  I  (X  )  given  in  (25)  yields 
upon  interchanging  the  order  of  summation  and  integration 

r'aO  V  ■  /  ^ 
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and  since 
•rC/z 


nt/z  ff/2  - , 

j  5irr'y/aiy/=  -f  dp  ^  2~ 


(^)! 

(f)'- 


(hi) 


and 


n-L 

2 


r-hl  )  I 

^  j  2  Bftl 


(U2) 


finally, 


. 


.  j-f'  Jd!"' 
e  4- 


Prom  inapeotion  of  (37)  and  (38),  it  is  seen  that 

-^=U 

dk 

hence,  using  (36),  (1;3)  and  (Itii) 

.v-tf 


5Cy>h.  R 

R. 


(ii3) 


(liU) 


C  ,  f  \  t  «\  Si-nh  R  R  tos  h  R-Sinh  R  ^ 

h(oi.)doc  =  e  - 7  =  ' 

~n 


{.hS) 


which  shows  that  h  (o4)  satisfies  Eq.  (35)* 

C.  Error  Probability  in  a  Binary  DCPSK5 

The  probability  of  error  in  a  binary  DCPSKS  (n-Z)  is  given  by 
(3)  and  (2)  as 


■f-K/2 


^  (^2)  =  1-[h(o<)  U 


Qt 


-rt/e 


(U6) 
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Now,  again  aaing  (32)  In  (U6)  and  expanding  the  Integral  in  (lt6)  as  the 
sum  of  two  integrals,  one  obtains  an  e^qpression  similar  to  (3^),  viz. 


.i-rt/z 


tiot  = 


where 


t'H/a  rtfz 

-ZZT  =  “  J*  cLol  J riyf  SLn  ^  e 
-rt/e  0 


K  -COS  Ot  Sift  ^ 


i-K/i  fC/S 

IZ  =  ^  y* cLu ^ eiy/  sirt^  p  -eos  ec  e 

-V/?  « 


/p  cos  oL  st'n 


Performing  the  integration  in  (U6)  irlth  respeot  to  first  this  time  by 
expanding  the  expooential  in  the  integrand  in  a  power  serlee  end  using 
(lil)  7iel<le 

^  J£n- 


-rr/z  ^  2  ' 

and  now  integrating  with  respeot  to  oc  end  using  (U.)  again  gives 


M 

^  ^  (ri- 1)  I  “  2R  f ®  “  0 


and  sinoe  also 


dm 
a  R 


m 


(52) 


so  that  (U7)  reduces  to 


h  (oc)  doL-e  ^  •/■  e  ^ R 

,  tL  K  ' 

TC/Z 


e  ^  r  <2* 


R/Z 


«  V 


(53) 


=  '/-  -L- 
2 


Substituting  (53)  into  (U6)  and  reoalling  (33) »  one  obtains  finally 


(5U) 


which  is  Identical  to  the  erqiresslon  obtained  previously  by  other  means 
in  References  (1)  and  (2) 


D.  Error  Probabilities  in  a  m-State  DCPSKS 


The  density  h{od. )  as  given  by  (32)  was  evaluated  on  the  IBM  70U 
ooii?)uter  for  values  of  R  -  E_  from  6  to  30  db  in  steps  of  2  db  (including 
also  *7,  -7>  -lU  db).  The  numerloal  integration  was  performed 

using  SipTOSon's  Rule  and  gave  h(o<.)  every  5°  for  90°  <  oc  £  loO°  and  every 
1°  for  0°<«i  90°.  Some  plots  ^f  h  (oi)  are  shown  in  Figure  U.  The 
cumulative  probability  HO  )  as  given  by  (2)  was  expressed  as 


'Ti/Z 

H  {e  ]  2  j  h  (oc) 


where  the  second  integral  in 
give 


'ft 

oLoi.  i-  2  r h  (oc)  cioc  (55) 

(55)  may  bo  evaluated  using  (35)  and  (53)  to 


H  (6)  =  2  j  h  (u)  doL  V-  e  ^ 


(56) 


The  value  of  h(oii)  at<x.- 


is  readily  shown  from  (29)  to  be 
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Using  the  values  of  h(«: )  obtained  in  one  degree  steps  as  described  above, 
a  seco-'d  mmerical  integration  again  using  Siaipsoi^s  Rule  was  performed  by 
accumuiatxi.^  f  0  )  in  2°^  steps  starting  from  0  -  ^  until  the  value  1  was 
attained  at  fo  “  Ot  Thus  for  a  fixed  R  ■  ^  ,  tables  of  H(0  )  were 
generated  at  2°  intervals  from  0®  to  90®.^ 

Since  the  probability  of  a  character  in  an  m-state  DCPSKS  is 
given  by  (3)  via. 

/D  (57) 

orossplots  of  F.(m)  vs.  ^  in  db  ware  readily  obtained  from  the  tables 
of  H(S)  for  m  ■  2,  15*30*^  corresponding  respectively  to  9  "  ot 
90®,  12®,  6®.  Error  curves  for  m  ■  U,  8  corresponding  respectively  to 
0  -  ^of  1(5°  end  22.5®  vere  obtained  by  interpolation.  The  resulting 
curves  are  plotted  in  Figure  5. 

For  m  ■  1(  and  ^  ■  10.8  db,  Pg(l*)  ■  .0089  which  is  fe^ly  good 
agreement  with  the  single^  point  calculated  previously  by  cahn'^1  who 
obtained  ,0083. 

E.  An  Approximate  Formula  For  the 
Error  Probabilities  When  m  >  2 

Some  relationships  between  h  (od)  and  some  special  functions  of 
mathematioal  analysis  axe 

h{oi)-h{lt-  oi)  =  Pi  T^[R.  /COS  ol)+  'COS  oL  [R.  -cos  o<i)J  ^^0^ 
(Tt-oi.]=  2  ^  \^i(^  -cosuycosoc  L.^(^  -cos  oi)^  (55) 

/,  (od] y-A (nr- O' )  =  ^  f ^ e ^ (t ^  cos « j  i  tTf 5  Qi  (i R  -cos ccj j|  (60) 

where  Ij,  L.,  and  Ei  (J  ■  1,2)  are  defined  in  APPENDIX  A.  For  example, 

(58)  may  be^obtainea  from  (32)  by  writing 


('/tR)  J  ^  ^  ;  R  e  ^ 


A  [oC)~h{n-ci)=-^  e  \l-ll  \  + 


I-U 
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PBOUBILITY  OF  OtmCTEt  EMOI 


< 


Figure  5  PROBABILITY  OF  CHARACTER  ERROR  IN  Tff  -STATE  DCPSKS 

(Computed  as  described  in  Section  II-D) 
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where 


rtf/ 2 


I  =  ^  \  Sin  y/  e  ctp 


C  -cos  Oi.  jin  y/ 


and 


n 


rC 


(62) 


'rt/^ 

,  'A  <05  nt  sin  >> 

Sit)  y/  e  oLy/ 


(63) 


Using  the  power  series  representation  of  the  eijqponentlal  in  the  integral^ 
interchanging  the  order  of  integration  and  atsnmation,  and  performing  the 
integration  with  respect  to  yj  with  the  help  of  (U.)>  one  obtains 


I 


iffT 


fe.  E 


{ R.  tos  oc] 


iil 


(61i) 


and 


/  V 


n  = 


2  iz 


ao  r  ,21  I  I 

(-f)  (R  ros  oc)  {  2  J  : 
r  I  ^  ri-1  ^  ! 


(65) 


Now,  in  the  difference  I>II,  the  even  powers  of  R  cos  oc  cancel  so  that 

(R  -cos  oc) _  ("4  -i- 1/^  ! 

{i*i  )  I 


00 


and  using  (l;2)  _  .s-Ai-l 


(66) 


oo 

i-n-E 


R.  f.as  oL. 


■A^O 


4  \  I 


(67) 


Substituting  (67)  into  (61),  a  little  regrouping  yields  (58).  Similar 
procedures  may  be  used  to  obtain  (5?)  and  (6o). 

Subtracting  (58)  from  (60)  and  using  (Al3)  and  (All*)  from 
APPENDIX  A,  one  obtains 


(68) 
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\rtiere 


<c>i  oi  -Tfii  e 

^ -CCS  9  ~  Oi)  d  9 


and  (65)  into  (55)  gives 
^  Y  ^  ^  ^  ^ 

6 "*  1  'H 

^  Fn  7“  ^  ^ 


I 

(69) 


(70) 


Eqaation  (70)  may  be  need  to  obtain  an  approximate  expreasion  for  H(  d  ) 
ae  given  by  (2),  namely 


h  ('«)=  1-2]  h  (Oij  rLr^c 


(71) 


The  second  term  in  (70)  tends  to  zero  for  large  R  ae  does  the  third  term  for 
oc  <fC/&  t  so  that  they  may  be  ignored  in  (71)  if  an  asymptotic  expreeslon  is 
sought*  Retaining  the  first  two  terns  of  the  aayn^lotie  expansions  of  I 
and  given  in  APPENDIX  k,  one  may  write  ^ 


(0h  i-'l 


■  e  (  f  ol) 


'  2“^ -cos  oi 


•i-COS  a.  + 


('  *se)  - 


8S  <05  ad 


Uoc  (72) 


I 


uf-s.IS.ii-  -coi  ot.)  sz  i:  R.  “ 

2 

Q=  (Jr!  Sin  -|- 


(73) 


then 


'  r 

/ 

0  2£ 

^  >e  (  BRi  ir-YP  aa  \ 

^  R  «  J 
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ll 

which  for  —  1  may  be  approximated  by 


9  ^ 

It  in  the  third  factor  of  the  integrand  of  (75)*  only  terms  of  the  order  of 
1/R  are  Mtalned.  one  obtains 


H  (&)=  1 


-A 

Ht'  j 


ci  a. . 


Now,  for  large  R, 


1 

8R. 


and  it  does  not  matter  much  whether  the  left  or  right  hand  side  of  (77)  is 
used.  Note*  however*  that  for  small  R  the  right  hand  side  of  (77)  is  to  be 
preferred  (for  example*  for  R  ••  1/8  the  left  hand  side  is  zero).  In  the 
hope  that  (76)  will  also  be  a  valid  approximation  for  moderately  small 
values  of  R*  one  can  write 

9 

y.. 


and  direct  evaluation  of  (78)  gives 


H{e}=  1-  -==;  f  du.  + 

J 


4/«  ./j 


Svmunarlzing  the  analysis*  an  approximate  expression  for  the  probability  of 
a  character  error  in  an  m-state  (m  >  2)  DCPSKS  is  given  by 
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H  (9  =  ( in  >z) 

H  {e}^  erft  Q  i-  —p=. 

4  i'fi 

Q  =  flW  SLY!  ~ 


Since  (80)  la  relatively  easy  to  oon^utej  extensive  tables  were  calculated 
on  the  70ii  and  the  results  are  tabulated  in  APPENDIX  B. 


In  order  to  check  the  error  with  which  (80)  approximates  P-(m)>  a 
special  program  was  written  for  the  70li.  This  program  computes 
H(^^)  by  numerical  integration  of  h(oi)  as  given  by 


h(oi.)  =  e  ^  '  1^1  S.  CoS  m )  i-  L,  (  €  fos  oi) 

+  -COS  oi  |~J  oL^  -h  Lg  ( R  -fas 


(81) 


which  may  be  obtained  by  adding  (58)  and  (59)«  Subroutines  were  written 
which  calculated  the  special  functions  from  their  series  representations 
riven  In  APPENDIX  A  and  the  program  was  especially  designed  to  give  P  (m) 
directly  without  the  necessity  for  interpolating  H(  S  ).  Tables  of  ® 
p^(m)  for  m  ■  U;  8,  16,  32,  61*  as  calculated  from  this  exact  expression 
are  given  in  APPENDIX  C  for  comparison  with  the  approximate  values  given 
in  APPENDIX  B.  It  is  found  that  the  approximate  formula  gives  P_(m) 
accurate  to  within  a  few  percent  over  the  range  of  E  from  0  to®  30  db. 

Since  a  set  of  curves  describing  P„(m)  as  m  increases  by  powers 
of  2  may  be  desired,  the  probabilities  compu^d  from  the  exact  expression 
which  are  tabulated  in  APPENDIX  C  are  plotted  In  Figure  6. 
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w 


•  13 


Figure 
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6  PROBABI  LITY  OF  CHARACTER  ERROR  IN 

^vjOiTipul/e\i  I'lC^Utiwion 


IS  20  24 

IN  c^ii 

m  -  STATE  DCPSKS 
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GUDCHAWUF.L  ERROR  PROB.\BILITY  IM  A  U-STATE  DCPSKS 
A,  Mathematloal  Formulation 


A  U-state  DCPSKS  ma7  be  considered  as  being  composed  of  two 
subchannels  in  quadrature  as  illustrated  in  Figure  7. 


4 


PRECEDING 

REFERENCE 

PULSE 


CHANNEL  A 


0 


270“ 


CHANNEL  8 


REF 


Figure  7 


2li 


AS 


-vine  :  tually,  the  detector  may  be  considered  to  consist  of  quadrature  dot 
■Toauct  detectors •  Let 

X  dot  product  of  received  signal  vector  with 

preceding  received  signal  vector • 

y  -  dot  product  of  received  signal  vector  with 
preceding  received  signal  vector  shifted 
90°  cloclcwise. 


then  the  detector  decision  matrix  is  given  by 


Lot  s  probability  of  an  error  in  channel  A.  Assuming  1  and  0  to  be 
transmitted  independently  with  probability  1/2  on  both  channels  and  that 
the  channels  are  independent,  it  is  possible  to  express  P.  as  the  sum  of 
conditional  probabilities  ^ 

^  =  ~Prob.('/.<  0/(7,7})  i-  Prob.  ( X>0/  (o,  1) ) 

"^4  f  ^  ^  Prob.  >  O/  (o,  0)  J  ^  ^ 

It  is  not  difficult  to  show  that  the  above  conditional  probabilities  are 
all  equal,  and  that  the  subchannel  error  probability  P„„„(l+)  of  a  li-atate 
DCPSKS  is  given  by 

Prob.  (x<0/ (83) 

Let  A  denote  the  peak  signal  amplitude  at  the  output  of  a  filter  matched 
to  the  transmitted  sinusoid.  If  2  successive  and  independent  samples  of 
the  output  noise  are  represented  by  their  in-phase  and  quadrature  components, 
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then  it  can  be  inferred  from  Figure  8  that  the  dot  product  y,  ,  assuitiin;', 
that  a  (1,  1)  was  transmitted,  is  given  by 


where  n,,  n2,  n,,  iw  are  independent  Gaussian  variables  with  zero  meaj: 
and  variance ana  it  is  well  known  as  was  stated  in  (1)  that 


(eii) 


FI&URE  8 


If  the  probability  density  of  x  is  denoted  by  g(  •/  )  then  from  (83),  one  has 


:iUB 


(4 


rj  X 


(dc-) 


.  .1'  >1'  a  Nc:;:ativo  Dot  Product  for  Two 

■/'■cv.oi's  I  idc;  cndor.t].;,’  Perturbed  Ijy  Gaussian  Noj  so 

The  expression  (81;)  is  a  special  case  of 

r  -  I  f  ^  fr,  (07) 

Consider  the  first  term  of  (87),  namely 

!  At  ;  ( t  )  +  xi.  1  (^’  ' 


?.G 


joint  density  of  and  if,  cjiven  by 

,  I  / 

■p  I  fl  .  n  j  -  - e 

'  2  'Tt  5“- 


z  z 
11.1  y- 


P.  S'' 


from  which  the  density  of  may  be  shown  to  be  given  by 


(6) 


1 


r 


( ^b) 


2'n:s‘ 


J 


\ul 


cS' 


The  second  term  of  (87),  namely 

\  ) 

is  also  distributed  according  to  (90),  and  since 


one  has  for  the  density  of  ,  the  convolution 


u. 


m 


(90) 


(91) 


(92) 


- 

Using  (90),  (93)  may  be  expressed  as  the  triple  integral 

r 


r  » 

/ 


(93) 


iui .  iT/i;  ^ , 

-  cc.  -  'x;  -■■■»>  y  I  ■■' 


Integrating^'  with  respect  to  x  gives 


/  '  ^  /,  V 


(95) 


!■/  I  y 


+  <V  XW 

1  r  rAip  f  dir 

iYJ/^ 


?  rr.  0'^) 


it 


IT 


(■ 


^  ^  1 


L _ 

"7  ^ 


U/ 


IJ-' 


\  iA.  1/  1/  Li  •  r 


u.' 


“>  V“ 


'/ 
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Letting 


u-  -  ros  S 
ir=r  Sir)  9 
gives 

1 


oo 


<^(x)  = 


_  [  I  ;  A*  {(^’  ^  t'  ,n,) ‘ 

f2U(r^P^\i 


0  o 

and  the  substitutions 


Xi,  =  iPS  cy.  cos 


^  *  ^26-^'^  ‘^Lf)  ^ 


y2  <os  )o 

-^4  >2 


r* 

X 


JO 

BIS'  »  ^ 


yield  the  density  of 

arc  an 


fdej^dyo  e 


Since  the  integrand  of  (99)  is  periodic  in  (9  and  is  integrated  over  t 
period,  one  may  write 

2  Tt  r  2  > 

e  -  ^ 

o  0  •/*  (  -f-  y3  -COS  &  I  J 

where 


Thus,  there  are  three  significant  parameter  oc  ,  y3  and  ^  . 


(96) 

(97) 

(98) 

(99) 

complete 

(IDO) 

(101) 
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'!oca\ise  of  the  relationship  between  x  and  B  given  by  (98),  one  has 


O  oo 


(102) 


and  from  (100) 


.  i”'  ^  Ajj^+^jooc  i:csio+<^)+ 


0  0  0 


Letting  B  ®  yJur gives 


«o  ec* 

;  f  ,  t  ,  -[d-f-2,0  ^  ^  <i^)  ^ 

P-  —ry.\d9  /oc(/odtve  L  •  an 

r  ■'J  f(,^-/3  «.s  gH 

0  0  c  ^ 


Since 


•lu.r-/^  <0%  0 ) 

e  ^  cLl<r  ' 


=  / 


&  "  oLi^  —  ~~^ —  "h 


-/i  (osy 


(103) 


and  because  any  2  TC-  range  may  be  used  for  the  Integration  with  respect  to  Q 
in  (lOii),  If  one  splits  the  9  integration  into 


J  d&  ^  }  cL9' 


•/ 

-71  777 

and  lets  9  ■  @  +  Tcr  in  the  second  range,  (lOU)  reduces  to 
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oo 

/» 


7K 


P 


n 


i/^ 


^pdp 


/•  -  +  Z/.i  €05  (e  ■^^)^oi'’)  ^ _ ^ 

I  dee  '  ^  ' 


-Tf 


! 


yj  CoS  !-■  .  , 

y-  /  e  ■'  d'f\ 


I 


Tt 

2 


y.y  d9  e 


oc  to5  {ei-i>)  -t- ot.^) 


(107) 

i  1  ._  /3*cs  4  -, 

■<>(./  i 


■^J 


£ 


or,  equivalently 


03 

1  r 

^  ~  Pi  ■ 


^  ^  +  zp  €c  to5{ B  +  ^)  + 

^.Pdp  ^  dQ  t 


3  ys  <.os  9 


(108) 


U 


3/2 


/T  4  /*  "  .p\  J/3  + Spot.  .C05  (f)  i-  <$)  -t  oc.^) 

Cpdp  j  je^ 


-I? 

2 


but 


1  f 

- I  ^ 

€>7r,y 

0 


•jxi  •  i  Tf' 

t  -  ( /j'- ^  gys  OL  '  l>-,i9  ’■If)'*-'*-*)  r 
/Oolpjrl  Qe  , 


-(/:>"  i^n 

pe  -C  f"  ‘ 


iJ  <7^  O  .-^  -^• 


(109) 


Evaluation  of  the  integral  of  Eqn.  (109)  fellows  upon  recalling^  ^  that  the 
probability  density,  &c/- (yo ),  of  the  envelope  of  a  sinusoidal  signal  of 
amplitude  oi  plus  Gaussian  noise  of  power  C^is  given  by 


ur{p)  .. 


./:> 

nr  ‘ 


/  \ 

4'  1 

1  ) 

(110) 


30 


aid  tli.-it. 


r 

j 


d/}  -  1 


(111) 


for  all  values  of  0'^,  If  tT  <*  1/2,  (109)  is  obtained.  Moreover, 
completing  the  square  in  /j  and  letting  r  -^0+  od  cos  (  ^  +  oii ), 
one  finds  that 


00 

r 


-h  2jO  <05  oc^)  I  ,  .  •‘r>^~oL^ 

=J(r-oo  <os{B-t<p)\c  di'' 


Of  C05(B'^ 


— —  -  oi  -co^  &  i-0j  e 


(112) 


oc  co.s^fl-f 

-f  e-'-‘dr 


and  similarly. 


-{p^- 2poL  <oi{e  +  i^)-t  (x) 


\  joe  d/o 


=  e 


-  (34*  5/  (  (>  *  P) 


« 

at. 

2 


04  eos {f>  tp) 


/W  I 


lT  ^ 


oL  i:os[9i‘^)e 
Substituting  (109),  (112)  and  (II3)  In  (IO8),  yields 


(113) 


7C 


^^ose 


d  =  - - I  de  C05[^  +  c/>)e 


Z  7tJ 

-Ti 

z 


J 


'  -f'  , 

e  oil. 


and  letting 


(Hi*) 


IL  =  y 

'ir  =  ry  5  i  n  -hifi) 


(115) 
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the  probability  that  the  dot  product  (8?)  is  negative  as  given  by  (111') 
becomes 


<X 


<a  t  u  / ~  0  j 

''  rJ 


(116) 


-Oi  cos  ^ 


The  double  integral  appearing  itj  (116)  has  an  interesting  geometrical 
interpretation  which  may  be  obtained  by  working  with  the  upper  limit 


yJ  <OS[SlW''  V~/ol  -0 


Expanding  the  right  hand  side  of  (117)  and  then  squaring  both  sides,  one 
obtains  after  rearranging  terms 


oL^  a.^  ir^  -  2  Lcv  ncji  sir>  ocr  yS  ^  p  (ilbj 

which  is  the  equation  of  an  ellipse  centered  at  the  origin  and  contained  with 
the  lines  u  ■  and  v  ■  i  oi  .  Hence,  the  integral 


ot  eas  y3  si*>  ’v/r<-  9^) 

jaiu 


-c<  ^  0 


tt 

is  just  the  integral  of  the  function  //  vr.  ■: 
in  the  right  half  plane  shown  in  Figure  '■), 


(115) 


over  the  shaded  ama 


oe»J,  y9»5,  p^30 


Figure  9 


Changing  to  polar  coordinates  by  letting  u  =  cos  and 
/.j  sin  9  ,  one  gets 

T6 


/o 

0 


/V.  r  )->  <T>  r* 'i 


j  9  '  rl  h -  /  .i  *9  I  .;/.i  I-’. 


I 


wh&re  is  on  the  ellipse  (Il8)  so  that 


2 

= 


oi  X5  -COS 


6  sir)^ 0  -2oe.y3  sd^i  'Ji  si Q  “^oS  Q 


and  it  is  seen  from  Figure  9  that 

at.  -ros  0 


tan  = 


o. 


/5  <f> 


'/3  sir?  0 


Performing  the  integration  with  respect  to  ^  in  (120),  and  from 
(119),  one  finds  that 


where 


P-=  /A/,  7-  7A4 


7t 

‘ 


r« 

•/ 


7  n  -  ros^ 0  <sc^  0 


dQ 


and 


-  7r/^ 

Letting  fp  "-0\7tf2  in  (12Ij)  yields 

rr/2  -cT 


IN 


1^-1-  C  p  d  q' 

;  I  - 


i/ 

o 


The  expression  (121)  for  /J  in  IN,  may  be  simplified  by  letting 


tx.^  r  to:  TP/?. 
/d  =  r  si  ri  2 


3l* 


(121) 

(122) 

(116)  and 

(123) 

(12U) 

(125) 

(126) 


(127) 


OO  ti.-.t 


and  using  the  half  angle  formulas 

sin  ^  r/2  =  1/2(1  -  -COS  y) 
C05'  2  -  /2  (f -h  fo5  r) 

(121)  becomes 


(128) 


(129) 


_  l/k  Sin""  y  €OS^  _ 

i-^-C05  2  6  -cost  -  Sin  2  0  Sin  ?'’3Lr)^ 


Defining  an  angle  t'  such  that 


.94  w  r= 


.S4>7  T  Sir)  0 


f '/ -stn^  T  0 

(130)  reduces  to 


;  -COS  r  = 


Cos  ir 


l-si,n'  cos  0 


(131) 


yO  = 
^  0 


and  letting 


r^/a  Sin ""  r  c:os  ^  0 


/■>"  /  1-siy}^  r  cos^0 '  <05  (29  f-v) 


(132) 


cos  =  siv)  cos  0 


(133) 


INg  as  given  by  (119)  becomes 


IN  - 


2 


e  <os  [se  *T) 


TC 

2 


de 


(13U) 


3J) 


36 


(y. 


ri<L 


Sen 


c/"  -  t 

r 


am 
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C.  Calculation  of  Error  Probability 
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It  is  intere;itinR  to  note  that  the  known  expression  (5U)  for  the 
probability  of  error  P  (2)  in  a  bijiary  DCPSKS  may  be  obtained  from  the 
set  of  equations  (137).  Assuming  without  loss  of  generality  that  a  zero 
phase  change  was  transmitted  in  a  binary  DCPSKS#  the  dot  product  of  the  two 
succeeding  received  signal  vectors  as  shown  in  Figure  10  is  given  by 


(138) 


and 


(139) 
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wliich  v/as  obtained  by  other  means  in  References  (1)  and  (2)  and  also  in 
Section  IIC  of  this  report. 
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yields 


In  order  to  evaluate  P_,_o  (U),  a  comparison  of  (8I4)  and  (8?) 


od  •■=  ^/3  =• 

^  2  ' 
and  since 


/I 

6  = 


E  1  & 

-r-  i  (f  =  tctr)  —  ;  r*®  = 


^0 

^  .  r- 


fT 


6'‘ 


(li*3) 


^  -f^  '  - 1  _ 

-r - tar)  -=■  =  tar 

2  fY' 


one  finally  obtains  from  (137) 


^sue^‘^^~9Tg  I  ^ 


an 


-  -^  ■&  sec^e,  ^  i 


tun  Z{z’ 

f  1  F 


2  % 


cL9  + 


J 


^TC 


(li.ii) 


g  ^  r/e 


(11*5) 


-Tf 


where  E  is  again  the  total  energy  per  pulse. 

The  expressicn  (lliS)  was  evaluated  on  the  lEM  70U  computer  and 
is  plotted  as  the  solid  curve  of  Figure  11.  The  character  error  rate  P  (U) 
of  a  four-state  DCPSKS  is  boiinded  by 


^SUB  (4)<  /^(4)  <  f'4) 


(11*6) 


and  2  P3U5(1*)  is  plotted  also  in  Figure  11  as  the  dashed  curve.  The  circles 
correspond  to  the  values  of  Pj.(U)  as  computed  according  to  the  description 
given  in  Section  II  of  this  report.  For  large  it  is  seen  that 

^c(*)  ~  (11,7) 

as  is  expected  intuitively.  This  serves  to  check  the  calculation  of  P  (U) 
described  in  Section  II.  Moreover,  in  cases  when  it  is  desirable  to 
feed  independent  signals  into  the  2  subchannels  of  a  U-state  DCPSKS,  ^303(1*! 
is  of  direct  interest. 


39 


PROBABILITY  OF  ERROR 


TV.  HEFEUENCES 


1,  Decker,  H.  D.  and  Lawton,  J,  Q.  Theoretical  Comparison  of  Binary 
Data  Transraiasion  Systems  Cornell  Aeronautical  Laboratory  Report 
No.  CA-1172-S-1  May  1958. 

2.  Cahn,  c.  R.  Performance  of  Digital  Phase  -  Modulation  Communica¬ 
tion  Systems  IRE  Transactions  on  Communications  Systems 

Vol.  CS-7,No.  1  May  1959. 

3*  Cahn,  C.  R.  Con^arison  of  Coherent  and  Phase -Comparison  Detection 
of  a  Four-Phase  Digital  Signal  Correspondence  Section 
Proceedings  of  the  IRE  Vol.  U7,  No.  9  September  1959. 

U.  Whittaker,  E.  T.  and  Watson,  Q.  N.  A  Course  of  Modem  Analysis 
The  MacMillan  Company,  New  York  191*6, 

5.  Watson,  0,  N.  A  Treatise  on  the  Theory  of  Bessel  Functions 
The  MacMillan  Company,  New  York  191*5. 

6.  Mood,  Alexander  McF.,  Introduction  to  the  Theory  of  Statistics 
MoQraw-Hill  Book  Company,  New  York  1950, 


1*1 


APPENDIX  A 


some  HelatloAshipg  concerning  the 
Special  Functions  Used  In  Analysis 


For  convenience  the  various  properties  of  the  special  functions  used 
in  the  analysis  In  this  report  are  presented  in  this  Appendix  as  obtained 
from  References  (li)  and  (5). 

Bessel's  Function  of  a  complex  variable  and  integral  order  n  >  0 
is  given  by 

y-TT 


'J,,  c^)= 


-■y> L  6  +  L  Z  Sin  9 

e  de 


If  Z  is  taken  to  be  pure  imaginary,  i.e.,  a  ■  ix  where  x.  is  real 


^  ^  ,  if  -*^(9 -p  sine  , 


In  particular  for  n  ■  0,  one  obtains  Bessel's  Function  of  zew  order  and 
pure  imaginary  argument,  namely. 


-X  stn, 


from  which  it  is  obvious  that 


hence, 


4  M  = 


I 

Z'tt  J 

-It 


■ji-  siri  e 

e  cio 


'■roi'\  ;r,  since  the  integrand  in  (Ait)  is  periodic  in  &  and  the  integral 
-s  taken  over  a  period,  2  ,  one  has 


■f-TC 


I  M  f  S 

®  2rt  J 

and  letting  pi  = 


X  Sin  (e  (H) 


d  e 
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,  .  1  T.  ^os  e 


-TV 


The  aeries  representation  of  ( if  )  ia  given  by 


CO 


■y*  [{r  i-  r))\ 


An  analogous  function 


1^=0 


I  (  yi-  1/i:  t  y?)  [ 


(a6) 


(A7) 


(a8) 


(A9) 


bears  the  same  relationship  to  Struve's  function  as  I  {x)  bears  to 
Jj^(Z  )  (see  Reference  5#  pg.  329).  Weber's  function  "of  pure  imaginary 
argument  has  the  series  representations  (Reference  3,  Chapter  X) 


and 


y  {x/£) 
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so  that 


(A12) 


Moreover, 


^J 

-‘7t/£ 


(A13) 


and 


V  K/£ 


If  (}i)~£^(iz)=  -  J  e“^  ^  ^os  9  d.e 


(Alii) 


-It/ a 


The  Identity  (Al3)  may  be  obtained  by  esqpandlng  the  integrand  at  the  left- 
hand  side  In  a  power  series,  performing  the  Integration  with  respect  to  d 
term  by  term,  and  breaking  up  the  resultant  series  into  two  series,  one  of 
even  powers,  the  other  of  odd  powers  at  %  >  If  in  the  series  of  odd  powers 
rl  is  replaced  by  the  expression  obtained  by  solving  (li2)  for  rj,  the  series 
so  obtained  is  readily  recognized  as  I  (s' )•  If  in  the  series  of  even 
powers  (r  -  t  is  rewritten  as 

'T+l/Z  ' 

and  (r  i')  1  is  replaced  by  (ii2},  the  series  so  obtained  is  readily 
recognized  as  (;<; ).  A  similar  procedure  may  be  used  to  obtain  (AlLi.). 


Finally,  )  and  (/i)  have  asymptotic  e^qpansions 
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APPENDIX  B 


Tables  of  Pj,(m)  as  Computed  From  Approximate  Formula 
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1(h)  DETECT  MEMO  NO  .  11 

'^"'^.TECT;  "Error  Prohab^litic!.''.  of  ni-stritc  Di  rrerontia] ly  Coherent 

Pl'.nsc  Shift  Keyed  SvEtome  (DCPSKS)  vrith  a  P^equoncy  Offset 
of  tlie  Received  Signals " 

PY:  Eugene  A.  Trabka 

Sl'M  j\RY 

Expressions  are  obtained  for  the  subject  error  probabilities  which  were 
tiion  evaluated  on  the  IBM  70).i  computer.  The  results  are  presented  graphically 
in  Firurc  3  and  also  in  tabular  form  in  Appendix  A. 

lYTRoa'CTIO!; 

The  operation  of  n-state  DCPSKS  was  described  in  Reference  1  at  which 
time  error  nrobat'ility  curves  representinp  their  performance  were  given.  It 
is  the  intent  of  the  present  analysis  to  obtain  error  probabilities  in  the 
case  whon  the  received  signals  are  subject  to  a  frequency  offset,  such  as  nay 
bo  caused  by  frequency'  errors  of  hctcrodj’-ne  oscillators  used  for  spectrum 
shJ  ftinj'. 

The  ix'cciver  input,  ^  C'f  )  >  again  assumed  to  consist  of  signal  , 

!  t }  ,  plus  vdiite  Gaussian  noise,  rl  [t)  ,  vri.th  single-sided  power 

spectral  density  watts /cps,  viz 

y{t)-  ^ 

T)ie  signal  component  of  the  receiver  input  may'  be  written  as 
^  ^  U.  [  -■ Ad/)),  (Sj)  t  -t  (-)  + 

4~-0 
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^  i 
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whert;  't(X)  is  the  unit  rectangle  function  defined  to  be  one  for 
and  zero  elsewhere,  T  is  the  duration  of  an  elementary  signal,  is 

the  carrier  angular  frequency,  A  (si)  is  the  frequency  offset  and  S  is  an 
arbitrary  unknown  phase*  The  are  random  variables  determined  by  the 

transmitted  information.  Ihe  0^  associated  with  the  k-th  interval,  as  shown 
in  Figure  1,  are  determined  at  the  transmitter  as  follows!  0^  is  an 

arbitrary  starting  phase  and  in  an  m-state  system  0^  is  chosen  such  that 

0^  -  has  one  of  the  m  equal  spaced  phases  ^ 

where  i  —  i,  2)  ••  yyi. 


— 

^ 0 

i>. 

-r  "  "  0  r  2T  jr 


FIGURE  1 


INTEGRATE.  HOLD  AND  DUMP  FILTERS 

The  receivinf  filters  are  assumed  to  be  of  the  "integrate,  hold  and  dump" 
variety  as  indicated  in  Figure  2,  and  described  in  Reference  2.  The  lumped 
parameters  L.  and  C  are  chosen  such  that  I/q  =  A  and  ~ 

Tlic  operation  of  the  s>iitchcs  in  Figure  2  is  as  follows;  SWl  and  SW2  are  open 

for  a]]  t  except  that  fjWl  is  closed  for  t  =■  -AT  where  -4  is  even 


2 


•>  .I.-iniinr,- 

DETECT  M'ltO  ro.  11 
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■ind  S'.72  ic,  closed  for  t  =  S  7  v;hcre  in  odd;  SV/3  in  uv  for 

I  AiJ-  /]  7  <  /•  <  /(•  T  i:!'oro  is  odd  end  doun  for  (\. - A <  7  ’(here 

-/f'  '  r-  oven.  Conscquontl”,  one  filter  is  all.owed  to  rinp  iii-ile  the  other  in 

"i  ntorratinr;". 


INTEGRATE,  HOJ.D  A>ro  DimP  FILTER 
FIGURE  2 

DliCTrUO!-:  PROCEG.S 

The  phase  difference  between  the  filter  outputs,  ^(t)  and  q  if) 
is  sampled  just  prior  to  t~-AT  (iic.,  at  t  —  -^kT~)  and  the  value  of 
— — —  {^L-l)  for  t  ss  ,  m  closest  to  this  phase  difference  is  con¬ 

sidered  tu  have  been  the  transmitted  phase  difference.  If  ri  is  even,  the 
ciafference  in  phase  of  the  keyed  filter  pair  is  taken  in  the  order  2  minus  1; 
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and  1  minus  2  if  -id  is  odd,  I-’  will  be  sufficient  in  determining  the  error 
probability  to  consider  the  statl.-.tic8  at  one  sampling  time,  say  t  ^  ST 

KEYED  FILTER  PAIR  OUTPUTS 


Formal  expressions  for  the  signal  components  of  the  keyed  filter  pair 
outputs,  (t]  ,  in  terms  of  their  respective  Inputs,  (t)  i 
are 


%.  Lt)=^ (v)  ter.  (t,V)  dVf  i=  t,  2 


(3) 


v/here  turrit, Z)  is  the  response  at  time  t  of  the  ith  filter  to  a  unit 

current  impulse  appliea  at  time  IT  ,  It  is  not  difficult  to  show  that  the 
voltage  I'esponse  of  the  upper  section  in  Figure  1  to  a  unit  current  impulse 
applied  at  time  t»-V  where  0<'^<T  is  given  by 

V/,[t,V)‘=  A  (t-r)  (h) 


and  the  voltage  response  of  the  lower  section  to  a  unit  current  impulse  tapplJ.od 
at  t  =  't'  where  T  <  V  <  2  T  isg^  ven  by 


ur(t,v)=Ai^ 


t-r 

JT-T 


(5) 


From  equation  (2)  and  taking  account  of  the  operation  of  the  switches  in  Figure  2, 
one  has  for  the  respective  inputs 


A. 

7 


(t)  =  UL  A 


(6) 


h 


for 


for 


where 


and 


where 
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0<.  t  <  T  and 


{t)  =  u.  ^  A  .<uAl,  ( C&)^  +A  dfiJ  jt  6?  0g 


(7) 


T<  t  <  2  T  •  Introducing  complex  notation  by  letting 

h.  (t)-  I^[h.  (t)  t  j-  ,  i  =  /,  -2 


(8) 


U]  -  All  [^r-rj 


I  jT-.r 


j 


(9) 


4  {t)  =  ^ 


5,  (t)e 


i  =  U2 


j,  (f)  =  Au.  [Yje 

S^(t)  =  Au.(-f^je 


(10) 


(11) 
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then 


<?•  (t)  e 


(12) 


where 


i-oa 


r  aoi'c 

e  dv 


(13) 


and  it  is  the  arguments  at  t  -  2T  of  Q,  (t)  (complex  numbers)  which 
are  the  desired  phases.  Using  (9)  and  (11),  one  obtains 

Qjj?f)=-^e  je  dr 

0 


r 


Letting  ^  Ca)  =  2TC>  ^  "P  ,  Af  —  7~  and 

performing  the  indicated  integrations  in  (lit)  yields 


See  Appendix  A  of  Reference  2 
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'X.  •’r 


i  f~0  i-  - ^  i-ocTC 


Q^2r)^E 


ir  Ll'.f  plinre  of  Q,(2T  j  minus  the  jihasc  of  Q  ^  ( 2  T  } 

':  Ai/)  ,  then 

J  <i  ■■  0-0  /  r 

^  k  1 


is  denoted 


vJl'.ere 


fc  =  2o^Tt 


(17) 


:-o  t)nt  the  effect  of  the  unknov;n  frequency  offset  hns  been  to  introduce  nn 
unknov.'n  hi  an,  6  ,  in  the  phase  difference  measurement. 


I'.linDR  PROOArdlJTY 


iJooT]  I’onr'iltinr  Reference  3,  it  is  oasiD.y  seen  that  the  fomal  expressior, 
for  the  f;b '! ra o l.e r  crir>r  iii'obald  ].ity  in  an  m-statc  DCPSKS  vri  th  frequency  offset 
of  th''  received  r.irnals  is 


p,  M 


(IP) 
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v.'liere  t.^-)  is  riven  tny  equation  (8I)  of  Reference  1  and  the  parameter 

ti  of  this  equation  must  be  taken  to  be 

n _ OL  Tt  ^  {19) 

\  / 

and  if  (16)  is  to  be  valid  for  integer  values  of  m  greater  than  one,  it  is 
required  that 


REaiLTS 

Tlie  expression  (15)  was  evaluated  on  the  IBM  70lj  computer  using  a  modifi-' 
cation  of  the  program  used  to  obtain  the  results  for  oc  0  reported 
in  Isference  1,  The  I’esults  ai’e  presented  graphically  in  Figure  3  and 
t.i'oulated  in  Appendix  A.  Dio  tendency  of  the  curves  representing  systems  in  th 
'1^  >  y.  to  approach  1  for  large  u.  vdth  increasing 
to  the  fact  that  if  the  bias  6  is  larger  than  the  decision  threshold  '^/fr) 

then  in  the  absence  of  noise,  wrong  decisions  are  rendered  with  certainty. 
iTliilc  Figure  3  illustrates  the  analytical  results  for  a  large  range  of  oc. 

it  is  well  to  bear  in  mind  that  in  many  practical  cases  values  of  rvi  of  the 
order  of  10"3  or  less  will  be  of  interest. 


0 


_E_  _  (ENERGY  PER  PULSE) 

Nq  “  (NOISE  POWER  DENSITY) 
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II  (a  1 
SU13JECT 

BY : 

SC^!^^.ARY 

The  theoretical  performance  of  several  phase  modulation  systems  em¬ 
ployed  for  the  transmission  of  digital  data  over  Rayleigh  fading  JW  tropos¬ 
pheric  scatter  circuits  is  analyzed.  The  probabilities  of  error  of  two,  four 
and  eifht-state  differentially  coherent  PSK  systems  are  computed  and  compared. 

A  t,ypical  I'T!  tropospheric  scatter  link  with  short-term  Rayleigh  amplitude 
fading  characteristics  is  assumed.  The  relative  importance  of  several  of  the 
transmission  system  farametera  jji  determining  the  resultant  error  rate  perform¬ 
ance  is  then  discussed.  In  particular,  consideration  is  given  to  tlie  effects 
of 

a)  different  orders  of  diversity, 

b)  a  lowered  FM  rece'’ver  threshold, 

c)  various  median  signal  levels, 

d)  operation  on  different  frequency  division  multiplex  channels. 
INTRODUCTION 

Considerable  effort  has  been  expended  recently  in  the  development  of 
phase -shift  keyed  techniques  as  a  method  of  transmitting;  digital  data.  This 
interest  has  de^'eloped,  principally,  because  of:  (1)  recent  developments  in 
practical  matched  filters  for  demodulatin!,  this  type  of  transmission, 

(2)  the  decreased  bandwidth  rcquircmcnt.s  of  PSK  systems,  and  (3)  the  superior 
theoretical  performance  of  KK  systems  with  respect  to  other  binary  systems 
in  the  presence  of  white  Gaussian  noise. 


DETECT  MEMO  NO.  13 

"Analysis  of  DCPSK  Digital  Data  Systems  Operating  over  a 
Fading  FM  Tropospheric  Scatter  Circuit." 

Harold  D.  Becker 
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■file  theoretical  error  rate  performance  of  a  binary  differentially 
■  nerent  PSK  (DCPSK)  system  operating  in  the  presence  of  additive,  white 
i.;aussian  noise  vras  derived  in  Reference  1,  This  work  has  been  extended  to  in¬ 
clude  the  analysis  of  m-state  DCISK  systems  as  reported  in  DETECT  Memo  No.  2A.  The 
results  of  these  analyses  are  now  applied  to  the  investigation  of  the  perform¬ 
ance  of  DCPSK  data  link  systems  when  utilizing  a  Rayleigh  fading  FM  tropospheric 
scatter  link. 

The  differentially  coherent  phase-shift  keyed  technique  has  been  brought 
to  an  advanced  state  of  development  in  the  Collins'  Kineplex  equipment.  One  of 
these  equipments  designated  as  the  OSC-U  is  designed  to  transmit  six  frequency- 
division  multiplexed  subchannels  of  differentially  coherent  PSK  signals  via  a 
ii  kc/s  channel.  The  use  of  a  DCPSK  system  of  this  type  for  the  transmission  of 
digital  data  over  a  typical  FM  tropospheric  scatter  circuit  is  shown  in  Figure  1. 
The  DCPSK  data  link  is  assigned  one  subchannel  of  the  frequency  division  multi¬ 
plex  system. 


OAT*  OUTPUT 

DATA 


Figure  I  BLOCK  OIAQRAM  OF  TROPO  SYSTEM 


The  DCPSK  system  is  assumed  to  consist  of  six  subchannel  tones  on 
which  the  data  is  encoded  as  differential  phase  shifts  between  adjacent  signals. 
The  duration  of  each  signal  element  is  1/300  seconds  and  the  six  tones  are 
spaced  300  cps  apart  so  that,  theoretically,  crosstalk  between  the  six  sub¬ 
channels  is  eliminated. 
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The  receiving  system  is  shown  in  Figure  2.  (The  symbols  used  to  denote 
-to-noise  ratios  at  various  points  in  the  receiver  are  explained  below.) 


OUTPUT 

DATA 


Figure  2  BLOCK  DIAORAM  OF  RECEIVIMQ  SYSTEM 


Tropospheric  scatter  systems  are  characterized  by  rapid  variations 

in  the  received  signal  level  which  may  be  assumed  to  be  Rayleigh  distributed 

as  well  as  long-term  variations  due  to  slow  changes  in  the  characteristics 

of  the  troposphere,  r.uch  as  variations  in  the  index  of  refraction.  In  this 

analysis,  long-term  fading  was  not  considered  except  that  computations  for 

different  median  signal  levels  were  made.  A  diversity  receiving  system  using 

Ideal  predetiection  combining  Is  postulated.  In  this  system  the  received  signals, 

which  are  assumed  to  have  independent  Rayleigh  amplitude  distributions,  are 

optimally  weighted  in  proportion  to  the  square  root  of  the  signal-to-nolse  ratio 

(2 ) 

of  each  signal  end  then  combined  coherently.  Brilliant'  '  has  derived  the  proba¬ 
bility  density  function  of  the  output  signal-to-noise  ratio,  W^,  of  this  type 
of  combiner. 

Ihe  theoretical  performance  of  an  FM  receiver  is  then  used  to  obtain 

the  relationship  of  the  receiver  output  signal-to-noise  ratio  (Wg)  to  the  input 

sifjnal-to-noise  ratio  (W-).  The  signal  energy-to-noise  power  density  ratio, 

^ 

,  at  the  input  to  the  DCPSK  matched  filters  is  then  calculated  with  respect 
to  W  Then  the  relationship  between  and  W  is  used  with  the  expression 

for  the  probability  density  function  of  to  derive  the  probability  density 
function  of  at  the  input  to  the  matched  filters.  The  probability  of 
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error  of  variouo  differentially  coherent  PSK  systems  are  derived  in  DETECT  Memo  Wo.  2A. 

OF  a  function  of  ,  assuming  that  a  maximum  likelihood  receiver  (matched 

'''o 

filter  receiver  or  its  equivalent)  is  used.  Assuming  that  the  fading  is  suf¬ 
ficiently  slow  so  that  these  results  may  be  applied,  the  average  probability  of 
error  is  computed  by  integrating  the  product  of  the  probability  density  function 
of  at  the  matched  filter  input  and  the  conditional  probability  of  error 

for  a  given  ,  over  all  values  of  . 


(3) 


DETAILED  A  MAI.  YS  IS 

If  two  or  more  signals  are  available,  the  fading  characteristics  of 
which  are  not  completely  correlated,  diversity  techniques  may  be  utilized  to 
obtain  performance  superior  to  that  available  from  any  one  of  the  signals  alone. 
If  it  can  be  assumed  that  the  signals  fade  independently  and  all  have  the  same 
Rayleigh  distribution,  the  analysis  becomes  tractable.  It  has  been  shown^^^ 
that  the  probability  density  function  ,  (W^),  of  the  signal -to-noise  ratio  at 
the  output  of  an  ideal  coherent  diversity  combiner  is  given  by 


(U) 


where  m  is  the  order  of  diversity  and  is  the  mean  signal~to-nolse  ratio  in 

each  channel.  The  mean  signal  level  can  be  expected  to  vary  hourly,  daily, 
monthly,  etc.,  as  the  conditions  of  the  troposphere  change;  however,  short¬ 
term  faditjg,  wh.ich  is  characterized  by  fadinj  rates  of  the  order  of  1  to  10 
cycles  per  qn'  -nd  1-,  found  to  follow  the  teyleigh  distribution  very  closely. 


The  actual  distribution  may  depart  somewhat  from  the  Rayleigh  distribution  due 
to  L  -ponents  of  a  reasonably  constant  level  caused  by  diffraction  or  specular 
re flee  tion. 

In  order  to  proceed  with  the  analysis  on  a  quantitative  basis,  the  fol¬ 
lowing  characteristics  taken  from  a  tyi^ical  FM  tropospheric  scatter  system will 
be  used. 


a. 

Minimum  yearly  received 

Median  signal 

80  dbm 

b. 

Design  target  received 

Median  signal 

60  dbm 

c . 

I.F.  bandwidth 

k  mc/s 

d. 

Receiver  noise  figure 

5  db 

e. 

Equivalent  receiver 

Input  noise  level 

-  103  dbm 

f. 

Maximum  deviation 

2LiO  kc/s 

g* 

Base  bandwidth  (77  channels) 

320  kc/s 

h. 

Pre -emphasis  at  320  kc/s 

26  db 

i. 

System  voice-channel 

Load  factor  (77  channels) 

18.5  db 

ItlG  pGrTniJi  S  .i.i ;  i,C  Gt^vJ  tltiJ.on  UII  UJ.  Olie  i  I  J.  I  uc  i  iVrf  li  j,V  i  5x01*1  Tiiux  i/x 

plexGd  channels  was  determined  in  accordance  with  [generally  accepted  channel 
OGsirnment  procedure . Pre-emphasis  is  employed  to  equalize  the  S/N  on 
each  of  the  77  channels  by  compensating  for  the  variation  in  the  noise  power 
density  over  the  various  channels  during  above  threshold  operation.  For  the 
assigned  pre-emphasis,  the  deviation  is  modified  with  modulation  frequency 
according  to  the  relationship 


lii-  \/tArn)N  <■< 


(h) 
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wi\ere  T  =  10  x  10"^^  and  (iJ  is  the  channel  radian  frequency.  Usi’^p  this  re- 

n 

l.itionship,  the  relative  deviation  (Scale  Factor)  on  each  of  the  77  cha.  .Is 
was  computed.  See  Table  I. 


TABLE  I 


1 

Channel  No. 

Channel 

Center 

Frequency 

Deviation 

Scale 

Factor 

Computed 

Deviation 

1 

6  kc/s 

i.l 

2.7  kc/s 

2 

10  kc/s 

• 

1.2 

3.0  kc/s 

• 

« 

\6 

• 

186  kc/s 

11.7 

• 

29  kc/s 

h6 

190  kc/s 

• 

12.0 

30  kc/s 

1 

« 

76 

• 

« 

31);  kc/s 

• 

• 

19.8 

* 

• 

1;9  kc/s 

77 

318  kc/s 

- 1 

20.0 

50  kc/s 

Because  of  the  random  phase  addition  of  the  subcarriers  and  the  nature 

of  the  iniormaolon  transmitted,  it  is  permissible  for  the  sum  of  the  deviations 

of  each  channel  to  exceed  the  prescribed  maximum  cariler  deviation.  'Die  stotns- 

() 

tical  nature  of  voice  signal  variations  and  cliannel  utilization  have  bocn  ‘ 

to  obtain  a  1''  'iht;  factor  curve.  This  curve  shows  that  J'or  a  77 -channel  system, 
the  loading  factor  is  approximately  18,5  db.  This  means  that  if  the 

ratio  of  the  s-  cified  carrier  peak  deviation  to  the  deviation  allotted  to  each 
cJiannel  in  tb  absence  of  pre-emphasis  is  18.5  db,  the  specified  carrier  devi¬ 
ation  v/i].l  r  oe  exceeded  more  than  one  pfjrcer.t  of  the  time.  The  loading, 
factor  is  p.  ,  by 


f  . 
(db) 


P() 


(6) 
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uhei".'  A  f  is  the  jieak  carrier  deviation,  and  is  the  deviation  per  channel, 
hlior.  :-e -emphasis  is  employed,  the  deviation  in  each  channel  is  nob  constant  and 
the  deviation,  f ^  ,  is  established  on  a  channel  near  the  mean  frequency  of  the 
nniltiplex  range.  The  mean  subcarrier  frequency  in  the  assumed  system  is  approxi¬ 
mately  185  kc/s  (channel  U5)  and  therefore  with  the  specified  loading  factor  of 
18.5  db,  the  deviation  f  ^  of  channel  hS  is  established  as  follows: 


20  log 


-  18.5 


2ItO  kc/s 


8.14 


21i0 

8  .li 


29  kc/s 


Tlie  deviation  of  each  of  the  other  channels  is  scaled  according  to  the  devi¬ 
ation  scale  factor  as  given  in  Table  1.  In  practice,  the  deviations  assigned 
to  the  lowest  frequency  channels  are  usually  increased  from  the  values  obtained 
above  in  order  to  combat  the  residual  noise  level  due  to  circuit  hum,  etc. 

The  performance  of  the  data  link  utilizing  channel  77  will  now  be  com¬ 
puted.  The  modulation  index  for  this  channel  is 


Mod.  Index 


0.1b 


Usinf  thin  modulation  index,  the  relationship  between  •U:e  input  and  output 
S/M  of  the  FM  receiving  system  may  be  used  bo  relate  and  Vlg.  The  expres¬ 
sions  coTtunonly  used  in  the  analysis  of  Hi  receiver  performance  are  valid  only 
v.'iien  the  signal  level  exceeds  the  threshold.  The  theorebical  noise  performance 
curves  for  a  frequency  modulation  receiver  operatinf  below  the  improvement 

(5) 

threshold  have  been  computed  by  !•'.  J.  Skinner  and  the  curve  corresponding 
to  the  I'Ti  system  postulated  for  this  analysis  is  plotted  in  Fifjure  3. 
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W^(dl))---  CARRIER-rO-NOlSE  RATIO  IN  R-H  BANDWIDTH 


f iyure  3  FM  RECEIVING  CHARACTERISTIC 


-II- 


Above  tlireshold,  the  noise  power  density  N(f)  at  the  output  of  the 
disci’ ;_^;inator  is  generally  assumed  to  be  proportional  to  the  square  of  the 
frequency.  However,  when  the  signals  are  well  below  the  threshold,  the  curves 
in  Skinner's  memo  show  that  N(f)  is  reasonably  constant  with  frequency.  There¬ 
fore,  well  below  threshold,  the  noise  power  (  )  in  the  320  kc/s  bandwidth  at 

the  output  of  the  FM  receiver  is 


Therefore, 


^  f  A/  ff)  df  =  =  (7) 

•4  ^ 

where  S  is  the  signal  power  in  the  6  subchannel  tones. 


Ai- 


(8) 


Mow,  let  Sj,  equal  the  signal  power  in  each  of  the  6  tones. 
Then 


J.2  ^ 

Js 


Hence, 


W  5.2  X  ro^ 

_p _ 

6  xJOO 


(db)  =  W  (db)  -A  22.5  db 


(9) 


(10) 
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For  every  value  of  .y  ,  the  corresponding  value  of  is  obtained  through 
the  use  of  EciUcition  (lO)  and  the  receiver  characteristic  ciirve  which  is 
plotted  in  Figure  3* 

(e) 

The  probability  density  function  of  is  given  by' 


pr/yj  - 


h/  a 


("'-01 


(11) 


The  probability  density  function  ,  ^  )  of  may  be  obtained  in 

'  o  p  , 

the  following  manner.  Let  expressed  as  a  function  of 


then 


The  value  of  is  obtained  graphically  at  each  value  of  from 

the  slope  of  straight  lines  tangent  to  the  actual  curve  in  Figure  3-  The 
equation  of  these  tangents  may  be  written  in  the  form  ij— A  where  A  is 

the  slope  of  the  curve  at  the  point  of  tangency. 

Thus , 


10  ”  A  10  -f-  b  (13) 


and  using  the  relationship 


'V  J  n...  .  'I 


~  10  - 


and 


differentiating  both  sides  of  Equation  (13)  with  respect  to 


resuj  in 


J-^g.  e 


A 

dh/i 


d 

O 


,  dt^, 
K  1 


Tlie  error  probability  is  computed  by  evaluating  the  integral 


(U) 


For  each  value  of  ,  the  value  of  the  integrand  of  Equation  (lU)  is 

computed  as  shown  in  the  sample  calculation  in  Table  II.  The  integrand  was 
plotted  as  a  funotion  of  ^/l\/  and  the  probability  of  error,  which  is  equal 
to  the  area  under  the  curve,  was  determined  by  graphical  means.  The  resulting 
probabilities  of  error  was  computed  in  this  manner  for  several  combinations  of 
DCPSK  systems,  orders  of  diversity,  m,  and  mean  signal  levels,  and  are  tabu¬ 
lated  in  Table  III.  A  four-state  DCPSK  system  may  be  obtained  by  combining 
two  binary"  DCPSK  subchannels  in  quadrature,  as  discussed  in  DETECT  Memo  No.  2A. 
The  error  probability  of  these  DCPSK  subchannels  is  Indicated  in  column  5  of 
Table  III. 

In  all  cases  which  were  examined,  it  was  found  that  virtually  all  errors 
occurred  viien  the  signal  level  faded  below  the  threshold  level.  Therefore,  this 
analysis  has  been  based  on  the  theoretical  signal-to-noise  ratio  perfoimanoe  of 
FM  receivers  operating  below  the  FM  threshold  which  has  been  investigated  by 
F.  J.  Skinner,  Although  Skinner's  analysis  was  derived  for  single  frequency 
modulation,  one  finds  that,  below  threshold,  the  noise  output  of  FM  receivers 
is  independent  of  the  modulation  frequency  and  Skinner's  curves  may  be  applied 
to  the  nrultiplex  case.  It  is  believed  that  the  perfor>iiance  predicted  by  these 
curves  is  approached  closely  by  conventional  FM  receivers. 
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BDCPSK  SrSTEM 
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TABLE  II  SAMTLE  COMPUTATION 


l/i 


TABLE  Ml  COMPUTED  ERROR  PROBABILITIES 


"ae  I'esults  obtained  in  Table  III  assumed  data  link  operation  over  the 

!  rst  'Jr  nuency  multiplex  channel  and  the  performance  over  other  channels 

could  be  com]’uted  in  a  similar  manner.  Hov/ever,  the  ranee  of  the  system 

naraviicters  considered  by  Skinner  does  not  permit  the  evaluation  of  tlie  per- 

(7) 

romance  of  the  veiy  low  frequency  channels.  In  another  analysis  by 
D.  P.  Harris,  a  convenient  set  of  curves  is  presented  from  v;hich  the  signal- 
to-noise  ratio  performance  in  any  channel  of  a  frequency  division  multiplex 
system  may  be  detei-milned.  Figui’e  U  has  been  deirived  from  Harris*  article  and 
illustrates  the  relationship  between  E/N^  at  the  input  to  the  matched  filters 
as  a  function  of  carrier-to-noise  ratio  vdth  channel  frequency  deviation,  f^, 
as  a  pai’ameter.  If  operation  is  assumed  on  channel  77  (f^  ■  50  kc/s),  the 
resulting  airve  in  Figure  h  is  fo\md  to  be  in  reasonable  agreement  vri.th  the 
corresponding  curve  taken  from  Skinner's  work. 


The  effect  of  channel  assignment  on  the  performance  of  a  given  data  link 
is  easily  obtained  from  Figure  li.  For  example,  if  operation  on  channel  77 
(f^  =  50  kc/s)  is  to  be  compared  with  operation  on  channel  15  (f^  ”  10  kc/s), 
the  factor  20  log  would  chan(3e  by 


20  2{f^=:  50 

_ 


20£of  =  -A-c/^) 

.  _  _ 


20.is^ 


J4-aib> 


From  the  slope  of  the  cui'Vf.-  in  Figure  )i,  it  is  seen  that  a  Ih  db  change  in  the 
value  of  the  ordinate  corresponds  approximately  to  a  7  db  change  in  the  carrier- 
to-noise  ratio,  , 


Referring  to  Tabic  IT,  it  is  soon  that  if  the  value  of  required  to 

obtain  a  f'iven  E/K  is  increased  V)y  7  db  (pov/cr  ratio  of  5),  botli  ^  ) 

and  oLW^  /  cL  wi  ll  be  increased  by  a  factor  of  5.  Thus,  in  the  case  of  dual 
diversity,  the  value  of  the  integrand  and,  hence,  the  integral  \d.ll  be  increased 
1  y  a  factor  of  25.  Therefore,  the  error  probability  of  channel  15  is  25  times 
as  great  at  the  error  probability  of  channel  77. 


••  iJi 


In  the  case  of  quadruple  diversity, 


•md  the  probability  of  error  would  be  increased  by  a  factor  of  625  if  operation 
were  shifted  from  channel  77  to  channel  15  of  the  assumed  system. 

( B) 

Nov;  HI  receiver  designs'  '  have  recently  been  developed  vdiich  attempt 
to  improve  HI  receiver  threshold  porfoimiance.  These  efforts  have  included  the 
application  of  ncrative  feedback  at  the  modulation  frequency  (IHIFB)  and  carrier 
insertion  techniques  of  reception  in  conjunction  ^h.th  the  FMFB  technique.  The 
theory  of  operation  below  tlireshold  of  these  receivers  has  not  been  adequately 
covered  in  the  available  literature.  If  it  may  be  assumed  that  the  perfoimance 
of  these  FT!  receivers  will  be  characterized  only  by  shifting  the  curve  of 
Fi.au'c  li  to  the  Toft,  the  effect  on  the  perfonriance  of  data  link  sj-stems  can 
be  easily  ascertained.  From  the  general  equation  for  the  M-fold  diversity 
combiner,  Equation  (11)  and  the  sample  calculation  of  the  probability  of  error 
in  Table  II,  it  is  observed  that  a  3  db  shift  in  the  threshold  is  equivalent  to 
a  3  db  increase  in  for  all  orders  of  diversity.  For  example,  if  the  HI 
threshold  is  moved  3  db  to  the  left,  the  required  value  of  will  be  decreased 
by  a  factor  of  2  at  each  value  of  E/U^.  Therefore,  the  resulting  error  rate 
vd,]l  be  decreased  by  a  factor  of  )i  in  the  case  of  dual  diversity  and  by  a 
factor  of  16  in  the  case  of  quadruple  diversity,  as  would  be  the  case  if  the 
transmitter  power  and,  hence,  were  increased  by  3  db. 

CONCLUSIONS 

This  analysis  shows  that  the  performance  of  digital  data  systems 
onerating  over  FM  tronosnheric  scatter  links  is  dependent  to  a  great  extent 
on  the  effectiveness  of  the  diversity  system.  The  analysis  assumed  an  optimum, 
nredetection,  coherent  combiner}  however,  contemporary  tropospheric  scatter 
systems  commonly  employ  post-detection  combiners  which  can  be  expected  to  be 
less  effective  in  Fli  systems  than  the  ideal  nredetection  combiner. Multiple 
diversity  systems  often  emnloy  a  combination  of  spatial  and  polarization 
diversity.  That  is,  each  receiving  antenna  may  contain  a  horizontally  and  a 
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verl icjaiy  polarised  feed.  It  has  been  found  that  the  amplitudes  of  the 
hori'^ontally  and  vertically  polarised  signals  arriving  at  the  same  antenna 
shovT  a  greater  correlation  than  two  signals  of  the  same  polarization  which  are 
received  at  separated  antennas.  Hence^  the  system  performance  computed  in  this 
memo  can  be  expected  to  be  optimistic  for  the  degree  of  diversity  assumed  if 
polarization  diversity  is  employed. 

This  analysis  also  indicates  that  the  error  rate  performance  of  a  pre¬ 
scribed  data  link,  transmitted  over  the  assumed  FM  tropospheric  scatter  link 
employing  pre-emphasis,  is  strongly  dependent  upon  the  assigned  multiplex 
channel.  This  results  from  the  fact  that  nearly  all  the  errors  occur  during 
the  small  fraction  of  the  time  when  the  fading  signal  is  below  threshold. 

In  this  subthreshold  region,  the  FH  receiver  output  noise  power  density  is 
found  to  be  very  nearly  independent  of  frequency,  and  equivalent  performance 
on  each  char.nel  would  be  achieved  if  the  same  deviation  were  used  on  all 
channels.  The  channel  deviations  In  FM  scatter  systems  are  commonly  established 
on  the  basis  of  performance  above  the  threshold  where  the  noise  power  density  is 
found  to  increase  as  the  square  of  frequency.  That  is,  pre-emphasis  is  employed 
vrhereby  the  channel  deviation  is  increased  with  channel  frequency.  This  is 
logical  for  use  with  voice  transmissions  which  would  be  judged  on  the  performance 
during  the  large  fraction  of  the  time  when  the  signal  is  above  the  threshold 
level.  Hence,  there  is  a  conflict  between  the  requirements  for  optimum  voice 
and  ontimum  digital  data  transmission  if  equivalent  performance  on  all  channels 
is  desired.  If  both  voice  and  digital  data  are  to  be  transmitted  over  an  Fll 
tropospheric  scatter  link  which  employs  pre-emphasis,  it  would  be  advantageous 
to  assign  the  channels  having  the  higher  deviation  (the  higher  frequency 
channels)  to  the  data  systems  and  assign  the  lower  frequency  channels  to  voice 
circuits. 

In  order  to  optimize  the  performance  of  scatter  circuits  for  use  with 
digital  data  systems,  the  threshold  perfoniiance  of  each  system  component  must 
be  considered,  such  as  the  dlversily-coJ'^ining  technique  and  the  detection 
teclinlque. 
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Jt  should  be  emphasized  that  this  analysis  has  considered  only  the 
effects  of  amplitude  fading.  It  will  be  necessary  to  extend  this  ane'ysis  to 
include  the  effects  of  phase  perturbations  of  the  received  signal,  .  urtioularly 
when  PSK  data  systems  are  being  considered. 
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Gaussian  Noise,  Quart.  Appl.  Math.,  15,  395'lil9  (1958). 

U.  iUce,  3,  0.  Mathematical  Analysis  cf  Random  Noise  from 

Noise  and  Stochastlo  Processes  New  York*  Dover  Publication,  Inc, 
195lt. 

5.  Slack,  M.  The  Probability  Distributions  of  Sinusoidal  Oscillations 
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INTRODUCTION 


A  substantial  body  of  literature  is  available  concerning  stochastic 
variables  vhloh  belong  to  the  normal  random  process.  There  is,  however, 
a  considerable  amount  of  noise  present  in  a  communication  link  which  may 
have  a  noticeably  different  statistical  character  from  the  normal  random 
process.  A  characterizing  feature  of  this  noise  is  Its  Inqjulslve  nature. 

The  elementary  disturbances  consist  of  sequences  of  pulses  of  varying  dura¬ 
tion,  intensity,  phase,  and  shape  and  with  random  occurrence  in  time.  Such 
noise  is,  in  the  literature, usually  termed  impulse  noise.  In  contrast  to 
the  body  of  literature  available  concerning  the  normal  random  process, 
that  concerning  impulse  noise  is  quite  meager.  A  foundation  does  appear 
to  have  been  laid,  however,  upon  which  further  investigations  might  be 
based. 

Middleton  (2)  defines  three  impulse  noise*  models;  (1)  periodic,  non¬ 
overlapping  impulse  noise,  (2)  nonperiodic,  non-overlapping  impulse  noise, 
and  (3)  Poisson  noise.  Of  the  three,  Poisson  noise  appears  to  be  of  greatest 
general  use  and  the  most  mathematically  tractable.  It  is  the  concern  of 
almost  the  whole  of  the  literature  on  the  subject  of  impulse  noise.  We, 
therefore,  restrict  our  attention  herein  to  this  process. 


Due  to  a  lack  of  sufficient  and  consistent  data,  it  remains  to  be  established 
that  the  disturbance  encountered  in  a  communication  link  which  is  commonly 
termed  impulse  noise  is  actually  represented  by  any  of  the  three  models. 
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Poisson  Noiae 

Poisson  noise,  results  from  the  linear  superposition  of  the  effects 
of  elementary  independent  impulses  which  occur  at  random  in  time.  In  prac¬ 
tice,  the  effect  of  each  elementary  impulse  is  given  by  a  particular  wave¬ 
form  governed  by  the  frequency  response  of  the  circuits  or  the  selective 
properties  of  the  medium  in  which  the  disturbance  is  evolved.  Middleton  (2) 
gives  the  following  descriptive  summary  of  Poisson  Noises 

"The  distinctive  feature  of  this  model  is  the  completely  random 
occurrence  of  the  elementary  impulses {  overlapping  is  common 
and  characteristic.  Familiar  physical  examples  are  atmospheric 
and  solar  "static,"  precipitation  noise,  ignition  and  lightning 
discharges,  the  interference  effects  of  randomly  oriented  scatterers 
in  the  medium  of  propagation,  etc.  Unlike  fluctuation  noise  or 
Brownian  motion,  where  the  density  (in  time)  of  the  individual 
effects  is  so  great  that  overlapping  is  extremely  frequent,  this 
latter  type  of  dlsturbanoe  is  characterized  by  relatively  few 
impulse  per  unit  time,  with  a  weak  overlapping  of  individual 
effects,  and  so  does  not  belong  to  a  normal  random  process*  Only 
in  the  limit  of  a  high  is^ulse  density  does  the  Poisson  noise 
(so  named  because  of  its  statistical  structure)  exhibit  gaussian 
properties." 

An  analj'tlcal  representation  of  the  first  order  statistics  of  generalized 
stationary  Poisson  noise  has  been  obtained  by  Rice  (li).  In  this,  the  waveforms 
of  the  elementary  pulses  are  assumed  identical  and  denoted  by  F(t),  The 
first  order  characteristic  function  of  the  random  wave  of  Poisson  noise 
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is  then  given  by 


Cu)  «  e 


4  U 


/■ro 


-d 


di 


(1) 


where  tJ  is  the  average  number  of  pulses  per  unit  time.  This  la  easily 
extended  to  the  case  in  which  the  amplitude  (a)  and  duration  (  r  )  of  the 
waveforiA  of  tlio  nlciiontniy  puloos  ai-e  stochastic  and  indenendcntly  distri¬ 
buted  according  to  ■'■  (&)  and  R(r).  in  thin  case. 
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Using  the  method  of  Rice  (2),  Middleton  (1)  and  (2)  has  obtained  a 
generalized  representation  of  the  nultiple-order  characteristic  function 
for  nonstationary  Poisson  noise.  This  is  of  a  form  similar  to  Eq.  2 
above,  but  considerably  more  complex  and  will  not  ba  discussed  in  detail 
here. 

Some  insight  into  the  nature  of  the  Poisson  noise  process  may  be  obtained 
by  examination  of  one  of  the  few  examptes  where  explicit  results  have  been 
obtained.  This  is  the  case  of  a  train  of  independent  overlapping  rectangular 
pulses  of  mean  duration  r.  In  this  case,  Eq.  2  becomes 

A  «  / 
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where 

/'•  V  T  is  the  average  pulae  "density*,  l.e.,  the  average 
n-uniber  of  ptilses  per  second  multiplied  by  the  average  duration  of  a  pulse* 

g^(u)  is  the  charaoteristio  function  of  the  distribution  of 
amplitudes.  The  probability  density  distribution  is  given  by 


J 


With  the  Poisson  noise  prooess,  there  la  at  any  given  time,  a  finite 
probability  of  having  no  noise  at  all,  and  this  is  represented  by  the 
</  -  function  of  strength  €  at  the  origin. 

For  a  Gaussian  distribution  of  amplitudes 


(5) 


5 


3  Januai'y  1  ^('-1 

DETECT  MEMO  NO.  6A. 
AF  30(602 )-2210 


the  characteristic  function  is  given  by 


.  -  (TM  1*  i  U.Q- 
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and  the  probability  density  distribution  of  Poisson  noise  becomes 
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The  probability  density  distribution  defined  by  Eq.  (7)  is  shown  in 
Fig.  1  for  several  values  of  average  pulse  density  C  .  The  oumulative 
probability  distribution  given  by  the  integral  of  Eq.  7  is  shown  in  Fig.  2, 

This  figure  is  a  plot  of  probability  that  the  abscissa  will  be  exceeded  in 
absolute  value.  In  each  case,  the  appropriate  gaussian  probability  distri¬ 
bution  or  cumulative  probability  of  the  amplitudes  of  the  elementary  pulses 
is  also  shown.  The  effect  of  increased  overlapping  of  the  eleaientary  pulses 
as  the  average  pulse  density  increases  is  apparent  from  either  figure.  At 
low  pulse  densities  when  there  is  little  overlapping,  there  will  be  appreci¬ 
able  gaps  (in  time)  between  successive  pulses.  Accordingly,  small  or  zero 
amplitudes  are  the  most  likely  to  occur  and  only  rarely  will  the  intensity 
of  the  Poisson  noise  wave  be  found  comparable  to  that  of  the  elementary 
pulses.  On  the  other  hand,  as  the  average  pulse  density  increases  and  over¬ 
lapping  becomes  more  common,  two  effects  begin  to  show  up.  First,  the 
Poisson  noise  wave  is  less  likely  to  be  found  with  zero  amplitude  and  secondly, 
there  is  an  increased  probability  that  the  Poisson  noise  wave  will  exceed 
the  intensity  of  the  elementary  pulses. 


C7) 
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In  addition  to  the  above  effeotj  the  magnitude  of  the  average  pulse 
density  has  a  substantial  bearing  on  the  nathematloal  traotabillty  of  the 
problem  of  obtaining  explicit  results  in  any  case.  In  the  limiting  case 
in  which  the  pulse  density  becomes  very  large  and  substantial  overlapping 
exists,  it  is  e:qpected  that  the  precise  fom  of  the  elementary  pulses 
becomes  relatively  less  important  since  their  individuality  is  lost  in  the 
combined  effect.  This  case  is  discussed  to  some  degree  by  Middleton  (2) 
and  by  Mullen  and  Middleton  (3).  On  the  other  hand,  in  the  limiting  case 
in  which  the  pulse  density  becomes  very  small  and  overlapping  is  negli¬ 
gible,  the  statistics  of  the  Poisson  process  will  be  Just  those  of  the 
elementary  pulses.  However,  in  the  region  between  these  limiting  cases, 
the  shape  and  statistical  properties  of  the  elementary  pulses  are  critical 
in  determining  the  statistics  of  the  Poisson  noise  process.  It  is  this 
fact  vhich  makes  a  general  evaluation  of  the  statistical  properties  of 
Poisson  noise  so  difficult. 

The  relatively  simple  result  of  Eq.  7  on  page  6  occurs  only  because 
of  the  idealization  of  pulse  shape  which  allowed  the  charactoristic  function 
to  be  derived  by  the  use  of  the  sum  of  k-fold  products  of  identical  elements. 
For  pulses  whose  amplitude  ohangos  with  duration,  this  procedure  breaks  down 
and  it  is  appeurently  no  longer  possible  to  obtain  explicit  results  for  all 
values  of  / . 

Mullen  and  Middleton  (3)  discuss  an  approximate  representation  of  the 
characteristic  function  of  Poisson  noise  which  is  valid  when  the  pxilse  density 
is  small.  Using  this,  together  with  work  of  Slack  (5)  curves  of  the  first 
order  probability  distribution  of  Poisson  noise  derived  from  rectangular 
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c-w  pulses  are  given.  A  short  tabulation  and  discussion  of  the  physical 
situations  to  which  Poisson  noise  applies  is  given  by  Middleton  (2).  In 
this, the  order  of  magnitude  of  associated  with  a  number  of  sources 
of  Poisson  noise I  together  with  the  character  of  the  distributions  of  the 
process  are  presented  and  discussed. 
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Figure  2  POISSON  PROBABILITY  DISTRIBUTION 

(probability  that  abscissa  will  be 

EXCEEDED  IM  ABSOLUTE  VALUE) 
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By:  Richard  Cleary 

SUMH^VRY 

The  contamination  of  the  signals  of  digital  data  transmission  systems 
by  noise  of  an  impulsive  nature  is  recognized  as  a  serious  limitation  on  the 
information  transfer  ability  of  such  systems.  This  memo  investigates  the  vord 
error  probability  of  a  system  using  close-paoked  codes  when  perturbed  according 
to  a  mathematical  modal  of  impulse  noise  proposed  by  Mertz^. 


Curves  showing  word  error  probability  vs,  long  term  average  letter  error 
rate  are  included  for  several  combinations  of  system  parameters.  These  curves 
will  allow  comparison  w'.th  the  performance  of  other  systems  currently  under 
study. 


Two  proposed  ert.ensions  of  the  present  analysis  are  described. 


■■  This  is  a  revision  of  DliTTECT  MEMO  NO.  3  which  was  originally  issued 
30  June  i960. 
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INTRODUCTION 

In  the  processes  of  detection  and  decision  involving  digital  data,  some 
of  the  most  serious  difficulties  encountered  over  certain  communication  links 
are  due  to  the  presence  of  inpulse  noise.  It  is  desirable,  therefore,  to 
devise  a  system  which  will  offer  substantial  resistance  to  this  type  of 
disturbance.  The  first  approach  to  this  problem  has  been  the  examination  of 
the  performance  of  certain  promising  data  transmission  systems  when  the  signals 
are  perturbed  according  to  a  mathematical  model  of  Impulsive  disturbances. 

The  minimum  effective  duration  of  a  received  inpulse  is  determined  by 
the  channel  bandwidth  and  is  equal  to  or  greater  than  the  reciprocal  of  the 
bandwidth.  If  we  postulate  that  duz*ing  the  presence  of  an  iiipulse,  the  channel 
output  is  independent  of  signal  input,  then  at  least  two  methods  of  combating 
impulse  noise  are  available  to  us.  One  is  to  make  each  symbol  (pulse)  long 
compared  to  the  reciprocal  bandwidth  and  another  is  to  encode  groups  of  symbols 
into  messages  which  contain  sufficient  redundancy  to  permit  error  correction. 

V/e  are  hers  concerned  with  the  latter  approach. 

Analysis 

\Je  identify  each  transmitted  pulse  with  a  letter  so  that  the  number  of 
letters  in  the  system  alphabet  is  equal  to  the  nuziiber  of  different  pulses 
employed.  The  mathamatiaal  model  of  inpulse  noise  which  is  enployed  is  due 
to  P.  Hertz^.  His  model  defines  the  probability  of  letter  error  occurrence 
in  the  following  way: 
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In  the  data  transnleaion  system  coneiderad  herein;  each  word  oonslsta  of 

a  sequenoe  of  n  letters^  eaoh  identified  by  one  of  k  possible  states. 

The  k°  different  aeqaenoes  (words)  whioh  may  be  thus  formed  are  oolleotively 

denoted  as  the  set  Sj^(n).  The  transmitted  signals  are  chosen  from  this  set 

and  form  a  subset  C  (C  for  oode)  of  Sj^(n).  We  wish  to  examine  the  susoepti- 

bility  of  the  system  to  ii^iulse  noise  as  a  fanotion  of  the  minimum  "distance 

between  words  of  the  oode^.  The  distance  between  two  words  has  for  the  present 

purposes  been  taken  as  the  number  of  letters  (in  corresponding  positions  in 

the  words)  by  which  the  two  words  differ.  Symbolically,  eaoh  word  of  S.  (n) 

n  ^ 

represents  a  point  in  the  n  dimensional  space  of  k  points,  A  single  letter 
error  will  carry  a  given  point  in  C  across  a  unit  distance  into  another  point 
of  the  set  Sj^(n),  two  errors  across  a  distance  of  two,  etc.  If  the  points 
(words)  of  the  subset  C  are  chosen  such  that  the  minimum  distance  between 
words  in  C  is  d,  then  -j=  or  fewer  letter  errors  will  result  in  a 
received  point  nearer  the  correct  (transmitted)  point  than  any  other  point 
of  the  subset  C. 


If  the  k  states  or  letters  are  identified  by  distinct 
frequencies,  a  k  -  ary  FSK  system  results  in  which  the 
bandwidth-time  product  required  per  word  is  approximately  kn. 

In  binary  systems  all  words  are  located  at  vertices  of  an 
n  dimensional  cube. 

The  svmbol  f  ^  is  read  as  "the  greatest  integer  in",  for  example 
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We  restrict  our  attention  to  "olose-paoked  oodes".  A  close-paoked  code 
has  the  woperty  that  ereiy  point  In  Sj^{u)  i*  a  distance  equal  to  or  less 
than  from  some  point  In  C.*  If  upon  reoaption  of  a  vord  of 

that  word  Wj  of  C  ehleh  is  at  the  smallest  distance  d^j  to  Is  designated 
as  the  transmitted  mov^  then  a  word  error  occurs  if  and  only  if  the  inuibor  of 
letter  errors  exceeds  |  .  Some  of  the  properties  of  error  oorreetlng  oodaa 

hare  been  discussed  in  the  literature  by  Hanslng^f  Ulrieh^  and  Lee^. 

Ve  seek  to  determine  the  error  probability  of  a  system  using  a  eloie>paOkod 
oode  C  of  distanos  d  when  the  signals  are  perturbed  by  impulse  noise  in  ao- 
cozdance  vrith  the  mathematical  model  of  Reference  (1).  All  words  of  the  code 
contain  exactly  n  letters  chosen  from  a  k  state  alphabet. 

The  conditional  probability  P(eA>urst)  of  word  error  In  the  presence  of 
a  burst  is  given  by 

n 

P  (e/burst)  ■  P(e/i)  P (i/burst)  (1)  i 

1-0 

wheiM 

P(e/l)  is  the  conditional  probability  of  a  word  error  given 
i  letter  errors 

P(i/bur«t)  is  the  conditional  probability  of  i  letter 
errors  given  a  oarst. 

If  the  decision  rule  is  to  designate  that  word  in  C  which  is  at  Ihe  smallest 
distance  from  the  received  word,  then 

P(e/i)  -  0,  i  -  0,  1,  2,  |j  (2) 

"  ^  "  j]  ^  " 

^'In  the  case  of  close-racked  codes,  d  is  always  odd. 
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vharaby  (1)  beoames 

P(€/  burst) 
I 


P(i/burst) 


(3) 


Two  oaeea  may  bo  diotingtdshed  according  to  whether  the  ratio  of  buret 
duration,  ^  ,  to  word  duration,  -ur  ,  is  greater  or  less  than  unity.  (It  will 
be  recalled  that  the  burst  duration  is  assumed  fixed.)  In  either  ease,  we 
assign  a  tine  origin  at  the  onset  of  the  word  and  denote  the  interval  between 
this  and  the  termination  of  the  burst  by  the  parameter  u  ,  idiioh  is  asBumed 
distributed  aooordlng  to 


/>(u)  = 


A  i-  w 


With  the  aid  of  Figure  1,  the  ease  in  which  —  >1  will  be  examined 

w 

first .  , 


I 

J 


Figure  1. 
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The  conditional  Poisson  probability  of  1  latter  terrors,  glTon  the  tins  Interral 
n,  may  ba  mlttein  . 


where  b  is  the  average  error  rate  wltMn  a  burst  and  T  is  the  letter 
duration,  i.e.  nT  w. 

*The  discontinuities  of  P(i/u)  are  a  result  of  the  particular  mathematical 
model  used.  In  practice,  P(i)  is  a  more  significant  parameter  than  P(i/u)} 
in  fact,  considerable  difficulty  in  determining  u  nwQr  be  anticipated. 


I  I 


I  I 

0 


Figure  2 
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In  this  case,  the  conditional  Polaaon  probability  of  1  letter  errors,  glren 
the  time  interral  u  ,  may  be  written 


P(o/u)=-  <- 


-U 


=  € 


-  h\^tLr  -(u~J  )\ 


pd/u)  =  0 , 


(bu)‘‘  -bu 
—Ti—  ^ 


(b/)'  ^-b£ 
e  f 


It 


Lt 


0  ^  u  ^ 


ti  6  Ztr 


U-"  i  u,  i  "Ur  -t  / 


u  ^  (i-f)  r,  i  >  1 


(c‘f)T  <  u  £.J,  iti 


£  u  ^  Vu- ,  i  i  f 


^b\j/j- -(u~  £  )^  - 

=  TT~  ^  »  ic/-  £.  u  £ 


=  0  ,  a  £.  ivi- £ -■  (i~!)T,  i  >  1  J 

t 

It  Is  worthtdille  at  this  point  to  note  that  (7)  may  be  obtained  from 
{$)  by  a  simple  interchange  of  vord  length  and  burst  length.  We  may  then 
immediately  write  the  equivalent  of  (6)  for  the  case  ^  <  1. 
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Returning  to  equation  (3)j  wa  may  write 


=  \p(e/burit)\  P( burst) 

V 


/-  y  P(t/burst) 

*0 


P  (burst) 


(8) 


vhloh}  upon  subetltutlon  of  the  Poisson  probability  of  a  burst  in  the  time 
interval  "ur-t-J  ,  becomes 


P(e)  = 


P(i/burst) 


L^O 


a  (urr£)e 


a(ur  rj^) 


(9) 


where  <a'  is  the  average  burst  rate. 

Finally,  with  the  aid  of  (6)  and  (9) 


dT 


Pe  -  i 


^  itri-ji 


(bur)' 


4L' 


e 


J  =  / 


,  J  I  -(i-f)bT  -bur.  ^ 


J?  T  f  [(t-f)bTy  -(C-t)bT 

^  Ml  j' 


(10) 


(  b  ur)  -  /j ; 


Ih 


JJ 


a  ( It  r-hJ?)  (“ 


-  a (ur  rjP.) 


w 


>  1 


The  probability  of  word  error  for  the  case  —  ^  1  may  be  obtained  from 
(10)  by  interchanging  and  w  , 


bur 
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Curves  of  word  error  probability  vs.  average  nunber  of  errors  per  word 
are  given  in  Figures  3«  U  &  5  for  several  oonibina'bioiis  of  the  paraiasters  J! 
(burst  length)  and  a  (average  burst  rate). 


Validity  of  the  Asa 


Dtions 


It  would  appear  worthwhile  now  to  eacamine  the  conditions  under  which  the 
Poisson  apprordmatl on  la,  for  practical  purposes,  an  adequate  representation  of 
the  binomial  distribution.  If  wo  denote  the  former  by  P(xj3c)  and  the  latter 
by  B(3C}n,  p),  these  conditions  may  be  written 


X  «  n 

X  «  n 

tdiidh,  for  the  case  in  question  becomes 


bw  «  n 


(11) 


(12) 


Further  analyses  which  are  prupoaod  below  are  expected  to  reveal  the  severity 
of  the  irestrictlons  in^osed  by  these  inequalities. 


Finally,  it  appears  desirable  to  examine  the  restriction  upon  the  average 
burst  rate  in  order  that  the  probability  of  multiple  burst  ocoiurenoe  in  a  time 
interval  z!^t  be  negligibly  small. 

Let  P(ija,  At)  designate  the  probability  of  i  bursts  during  an  Interval 
of  duration  At  if  the  average  rate  of  burst  oocurrenoe  is  'a'  bursts  per 
unit  time. 

P(o’,a.,At)  -  e 
P(Ua,At)  “  a. At  e 
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Probability  of  no  overlai>  = 

=  P(o,Q-,^t)  +■  P(l,a,At)  =(i+a.^t)e 

a  /  If  aAt  «  1 

Eor  the  case  In  qaeetion  , 

At  •  Ji  *je 
and  (13)  requires 

a(v+  J  )  •  air(l+  5  )  «  1  (lU) 

Most  oases  of  practical  Interest  are  bellered  to  satisfy  this  Inequality. 
Proposed  Further  Effort 

The  applicability  to  a  practical  systesi  of  some  of  the  assuaptlons  about 
impulse  noise  as  used  herein  Is  open  to  some  questions*  Principal  among  these 
assumptions  are  the  foUcwlngi 

1.  Within  the  time  Interral  oooupied  by  a  bursty  the 

probability  of  letter  error  occurrence  has  a  Poisson  distribution. 

2*  For  a  given  trananlssion,  the  tli..e  interval  occupied  by 
a  burst  is  fixed. 

The  principal  objection  to  the  fir  )f  these  is  that  the  maximum  number 
of  errors  permitted  by  the  Poisson  dist  utlon  irithin  a  finite  time  interval 

is  unbounded,  while  in  practice,  at  nrs  .:11  of  the  letters  of  a  word  can  be 
in  error. 
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Sufficient  data  upon  vhich  to  judge  the  validity  of  assumption  (2)  above 
is  not  yet  available.  However,  it  m^r  be  argued  Intuitively  that  burst  length 
should  bo  represented  as  a  stochastic  process  aoj.:.ned  by  a  probability  density 
distribution  function. 

To  overcome  the  above  difficulties,  it  would  be  desirable  to  replace  (1) 
and  (2)  from  page  11  with  corresponding  observations  which  are  based  upon  a 
substantial  body  of  evidence.  Although  there  was  some  doubt  that  such  a  body 
of  evidence  existed,  a  literature  search  on  the  subject  of  lopulse  noise  was 
undertaken,  the  results  of  this  literature  search  are  reported  in  Appendix  III (a). 
It  was  proposed  that  (1)  and  (2)  from  page  11  be  replaced  vdth  the  following 
(intuitively  more  reasonable)  assun^tions* 

1,  V/'ithin  the  time  Interval  occupied  by  a  burst,  the  probability 
of  letter  error  occurrence  has  a  binomial  distribution. 

2.  Burst  duration  is  represented  by  a  stochastic  process  and 
has  a  uniform  distribution. 

The  first  of  these  satisfies  the  requirement  that  the  number  of  errors  per 
word  cannot  exceed  the  number  of  letters  per  word,  while  retaining  the  idea 
of  random  error  occurrenee  within  a  burst.  The  uniform  probability  distri¬ 
bution  of  burst  duration  (assumption  2)  expresses  the  feeling  that,  with  the 
data  available,  no  preference  for  a  particular  duration  can  be  stated. 

Analysis  using  these  assumptions  has  been  carried  out  in  Appendix  III(o), 
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b  ur  (EXPECTED  NUMBER  OF  LEHER  ERRORS  PER  WORD) 


Figure  3 
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III(c)  Addendum  to  DETECT  MEMO  NO.  3 

Subject;  "Error  I^bability  of  a  System  Usin^  Close-packed  Codes 
in  the  Presence  of  Impulse  Noise" 

By;  R.  E.  Cleary  and  P.  Criini 

References:  (1)  Mertz,  P.  Model  of  Impulse  Noise  for  Data 

Transmission  Rand  Report  I'-1761  2?  July  1959- 

(2)  Cleary,  R.  Error  Probability  of  a  System  Usint; 

Close -packed  Codes  in  the  I'resence  of  Impulse  Noise 
CAL  DETECT  MEMO  NO.  3  30  June  i960. 

SUMLARY 

This  memo  represents  an  extension  of  DETECT  MEMO  NO.  3.  An  analysis 
is  presented  of  the  word  error  probability  of  a  system  using  K-ary,  close- 
packed,  error -correcting  codes  when  perturbed  according  to  a  mathematical 
model  of  impulse  noise.  The  impulse  noise  model  employed  is  that  due  to 
P.  Mertz,  with  the  modifications  proposed  in  the  final  section  of  DETECT 
f®-10  NO.  3. 

INTRODUCTION 

Reference  (2)  analyzed  the  word  error  probability  of  communa-cations 
systems  using  K-ary,  close-packed  codes  v/lien  perturbed  according  to  a  mathe¬ 
matical  model  of  impulse  noise  proposed  by  Mertz  in  Reference  (l).  It  was 
proposed  that  two  of  Hortz's  assumptions  be  replaced  with  the  modified 
assumptions  shov/n  on  the  following  page. 
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Hertz's 

Modified 

Assumption 

Assumption 

Distribution  of  the  probability  of 
letter  errors  within  a  burst  of 
impulse  noise. 

Poisson 

Binomial 

Distribution  of  the  length  of 

All  bursts 

Uniform 

bursts  of  impulse  noise 

of  equal 
length 

Thla  addendum  preaenta  an  analyala  of  the  word  error  probability  of  a 
system  using  close-packed  error  correcting  codes  when  perturbed  according  to 
the  modified  model  of  impulse  noise*  While  the  asaun^tion  of  a  Poisson  distri¬ 
bution  of  burst  occurrence  has  been  retained  as  far  as  the  conqoutation  of  the 
probability  of  a  burst  overlapping  a  word  is  concerned,  the  following  assur^jtion 
has  been  made  for  reasons  of  analytic  convenience t  a  burst  of  noise  overlaps  a 
word  by  a  pezlod  of  duration  equal  to  that  of  an  integral  number  of  letters. 
Aside  from  the  changes  specifically  noted  here,  the  data  transmisaion  system 
and  impulse  noise  model,  as  well  as  the  notation,  are  as  described  in  Reference 
(2). 


Analysis 

We  seek  to  determine  the  error  probability  of  a  system  using  a  close-packed 
code  C  of  distance  d.  when  the  signals  are  perturbed  according  to  the  modified 
model  of  iotpulse  noise.  All  words  of  the  code  contain  exactly  n.  letters  each 
of  duration  T  and  each  chosen  from  one  of  -h  possible  states. 

We  assume  that  the  decision  rule  is  to  designate  as  the  transmitted  word 
that  word  in  C  which  is  at  the  smallest  distance  from  the  received  word.  Then 
the  conditional  probability  of  word  error  given  an  overlapping  burst  of  durat-  'n 
ju  T  is  given  by 

^  1* 

PTe  j  -  1  P  Cl  ]  n,  fo/o ,  yu)  (1) 

i-a 


The  qymbol  [  ]  is,'  as  in  Reference  (2),  read  as  "the  greatest  integer  in"j 
for  Gxanple,  [3/2]  “  1» 
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where  P  (I  ]  n  ^  p/o  ,  /a')  is  the  conditional  probability  of  exactly  I  letter 
errors  in  a  word  containing  letters  vrtiich  is  overlapped  by  a  burst  of  duration 
when  the  probability  that  any  one  letter  overlapped  by  a  buret  is  in  error 
is  yo  ,  In  the  sequel,  the  parametric  dependence  of  the  various  probabilities 
on  n  ,  ^  ,  and  d  is  implied,  even  though  it  is  not  written  explicitly. 

As  in  the  analysis  of  Refeienee  (2),  two  cases  may  be  distinguished  according 
to  Aether  the  ratio  of  burst  duration  T  to  word  duration  cu  •  tiT 

is  greater  or  less  than  unity.  In  either  case,  we  assign  a  time  origin  at  the  onset 
of  the  word  and  denote  the  interval  between  this  and  the  tenaination  of  the  burst  by 
YnT  * ^  where  m  is  assumed  distributed 


P(m) 


1X  f /A'  i 


With  the  aid  of  Figure  1,  the  case  in  which 


>  1  will  be  examined 


first. 


« 


Note  that,  in  view  of  our  assunqjtion,  the  parameter  -fn  takes  on  only 
integral  values. 
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The  conditional  probabililgr  of  L  latter  errors  is  glfan  by 

p  (i-  )  »  O  ,  fn  <  i  > 

‘  C  L  i  in  i  n,  (3) 

-  g  •f))*"''' ,  fl  ^  m  <yt<, 

tL*jU.-m  •  A+jU-fn-c 

-c  '  ^  fn.  ^  yU  - L  , 

=  o  y  fn  >  ft  f  /U  -  i  . 


The  case  in  tdilch  -  ■  <  1  may  be  examined  with  the  aid  of  Figure  2, 

ijLf  n 


t-  -  n 


_ rL_ 

t - ^ 

nT - 

Figure  2 
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In  this  case,  the  conditional  probability  of  i-  letter  errors  is  givan  by 


P  ( i  / fn,  o  .ja')  =  O ,  fn  L , 

-  p'  \  i<.in  4/^, 


/O  t  j  \  ^  ^ 


M  <  ^  4.  ^ 


AfA-m  ;  y 


<fn4  -n  i-/A-L  , 


fn  >  K  1-  ^  -  L 


We  may  now  write  that 


P(i/o,_M')‘^  PM  (1 

■Ox 

Utilizing  Equation  (1),  the  expresaion  for  the  probability  of  a  word  error  Ist 

pro  - z f pA'A. a  p(o,^)  « 

M-  ^  it  0  J 

where  o  stands  for  overlapping  buret  and  P  o,^')±b  the  probability  that 
a  word  will  be  overlapped  by  a  burst  of  duration  T  •  As  in  the 

analysis  of  Reference  (2),  the  burst  occurrence  is  assumed  to  be  specified  by 
a  Poisson  distribution,  while  is  assumed  uniformly  distributed  over 

that 


P(o,/a') 


-  a.Cuj+ 


\  a.uj(l  t  n.') 
M  tTj3.1t  ^  ^  / 
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where  is  the  average  burst  rate.  Note  that  this  is  the  probability  of  a 
single  burst  occurring  in  the  time  interval  ur  *  -I  (the  ihole  interval  is 
used  since  it  is  assumed  that,  if  a  burst  overlaps  even  part  of  a  letter,  it 
may  be  regarded  as  overlapping  the  whole  letter).  The  word  error  probability 
thus  does  not  include  the  contribution  due  to  the  occurrence  of  more  than  one 
burst  overlapping  the  word.  However,  it  nay  be  shown  (Reference  2)  that  the 
probability  of  two  or  more  bursts  overlapping  the  sane  word  is  very  small  in 
most  cases  of  practical  interest. 


Substituting  Equation  (7)  into  Equation  (6),  one  obtains 


/ 


Mn/ir  r 
/1.1  ( 


1-f 


(8) 


<•0 


The  probability  of  a  word  error,  as  given  by  Equation  (8)  above,  is  plotted  in 
figure  3  as  a  function  of  the  expected  number  of  letter  errors  per  word  (the 
latter  being  equal  'to  ^  ^  )  for  two  selected  values  of 

(X.  uj  t  For  purposes  of  conqsarlson,  the  word  error  probabilities  using  the 
original  assunptions  (i.e.,  (1)  the  occurrence  of  letter  errors  is  governed 

by  a  Poisson  dietrlbutionj  (2)  is  assumed  constant  and  equal  to  the  mean 
valuers  of  ^  for  the  corresponding  case  with  /x  variable)  are  also  plotted 
in  Figure  3. 


CONCLUSIONS 


As  nay  be  seen  from  Figure  3,  over  the  range  of  variables  plotted,  the 
probability  of  a  word  error  in  a  close-packed  error  correcting  code  as  computed 
under  the  more  realistic  assumptions  of  a  binomial  distribution  for  letter  errors 
and  variable  burst  duration  does  not  differ  drastically  from  the  probability  as 
computed  under  the  simpler  assurptions  of  Reference  (2).  It  may  be  concluded, 
then,  that  reasonably  accurate  word  error  probabilities  may  be  computed  by  assuming 
constant  burst  duration  and  a  letter  error  occurrence  governed  by  the  Poisson 
approximation  to  the  binomial  dlstri'-ation. 


PROBABILITY  OF  WORD  ERROR  (P(e>) 


111  (^ctobor  l?6o 


Figure  3 
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Jubjcct:  "I'opicnt  '•tontion  in  the  I’rannnce  of  VJhite  fiausnian  Noise" 
By:  T.  i'.  Chant 


Sin-^IARY 

The  performance  of  moment  detection  in  the  presence  of  additive  white 
gaussian  noise  is  analyzed.  The  functional  dependence  of  the  nrobability 
of  error  on  the  ratio  of  average  transmitted  energy  (per  symbol)  to  noise 
power  spectral  density  S is  determined.  Wiere  this  functional  r  elaticn*- 
ship  could  not  be  stated  in  closed  fonn,  closed  form  expressions  for  upper 
anu  lov.'cr  bounds  have  bean  obtained. 

It  is  shown  that  all  moment  detection  processes  can  be  replaced  by  the 
use  of  linear  filters  having  appropriate  impulse  responses.  The  converse  is, 
however,  not  truej  that  is,  linear  filter  detection  cannot,  in  general,  be 
replaced  by  moment  detection. 

The  organization  of  this  memorandum  follows  that  of  the  original  work 
at  Rutgers  University  (Reference  1).  However,  the  treatment  h^  been  extended 
to  include  certain  effects  not  previously  considered.  The  material  is  pre¬ 
sented  in  four  sections,  as  follows: 

1.  Moment  detection  of  a  single  pulse 

2.  Moment  detection  of  multiple -pulse  groups 

3.  Kffect  of  a  filter  preceding  the  moment  detector 

U.  Effect  of  pulse  overlap  (intersymbol  interference) 


-i^This  is  a  revision  of  IiPTTECT  MTJIO  NO.  1  which  was  originally  issued 
2h  May  I960. 
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INTRODUCTION 

In  1957 1  a  decision  method  for  the  decoding  of  pulse  coded  signals  was 
described  by  a  group  at  Rutgers  University  College  of  Engineering  (Reference  1), 
The  method  was  called  moment  detection.  This  memorandum  investigates  the  theo¬ 
retical  psrfomance  of  moment  detection  in  the  presence  of  additive  white 
gaussian  noise. 

The  basic  idea  of  moment  detection  is  that  by  determining  a  s\ifficient 
number  of  the  temporal  moments,  M.  (T  S(t))  =  /  t  S  (t )  c/ 1  ^  of  a 
Lime  limited  signal  S(i)  ,  that  signal  can  be  specified  to  any  proscribed 
degree  of  accuracy.  Discrete  pulse-coded  signals  may  be  uniquely  idontifiei  by 
specifying  one  or  more  of  the  temporal  moments.  The  integer  k  designatee 
the  order  of  the  moment;  thus,  is  the  zeroth -order  moment,  which  happens 

to  be  the  area  under  5  is  the  first-order  moment,  etc. 

It  is  convenient  to  call  the  set  of  possible  transmitted  signals  a  code  ,  (T, 
and  to  call  each  possible  transmitted  signal  a  word.  We  are  concerned  with 
binary  codes  in  which  each  word  consists  of  a  sequence  of  Identical  pulses. 

The  pulses  in  each  word  can  occur  only  at  prescribed  uniform  intervals.  All 
words  in  the  code  have  the  same  number  of  pulse  positions  and  the  words  differ 
only  by  the  number  and  location  (in  time)  of  the  pulse  positions  which  are 
occupied.  It  Is  found  that  there  (usually)  exists  some  A,  such  that  each 
word  in  the  code  results  in  a  unique  value  of  A^^  for  each  word  in  the 
code  C  (there  may  exist  some  pathological  pulse  shapes  for  which  this 
statement  is  not  true).  Although  the  use  of  such  a  value  of  A  results 
in  a  very  simple  decision  doctrine,  the  probability  of  error  in  the  presence 
of  noise  may  be  greater  than  with  other  schemes  to  be  described  below.  The 
reason  for  this  is  that  the  larger  value  of  A  required  in  order  to  obtain 
unique  results  in  smaller  percentage  differences  between  the  various 

and  a  larger  variance  due  to  noise.  It  is  found  that  lower  probability 
of  error  results  vriien  the  decision  is  based  on  the  measured  values  of  several 
low  order  moments  rather  than  on  a  single  higher  order  moment. 
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1.  Moment  Detection  of  a  Single  Pulse 


The 


h  th  temporal  moment  Mm(T,  S(t))  of  a  signal  S(i)  on 

n  7"  if 


the 


interval  [C,  rj  is  defined  by  M^(T,S(t))=  J  t-'^S(t}dt  ,  We  can 
easily  show  that  the  moments  M^CT,  S(t))  can  be  obtained  by  linear  filtering. 
Thus,  consider  a  linear  filter  having  impulse  response. 


(t)  = 


0<  t  <  T 
Of  elsewhere 


(1.1) 


LINEAR  FILTER 
hj^(t)f  H^(f) 


So(t) 


The  output  Sgd)  of  this  filter  in  response  to  an  input  signal  Si(t)  is 
then  given  by  the  convolution  of  5/  (t)  and  (t)  , 


Sod) 


S;  M  h^(t-r)  dt 


Si(T)  (T-t  +  Trdr 


The  output  at  time  t  -  T  is  then 


Sc,(T) 


T 

Si(T)  r 


A 


dr 


( T,  Si  (t)) 


Thus,  the  output  at  t  T  of  a  filter  having  impulse  response  given 

by  Equation  (l,l)  is  precisely  the  th-order  moment  of  the  input  on  the 

interval  7"  |  .  Decisions  based  on  the  measurement  of  several  moments  of 

different  order  are  equivalent  to  decisions  based  on  the  output  of  several  filters 
having  the  appropriate  impulse  responses. 


Throughout  this  memorandum,  it  is  assumed  that  the  appropriate  time,  T  ,  at 
which  to  sample  the  output  of  the  filter(s)  is  precisely  known;  this  assumption 
is,  of  course,  equivalex'iL  to  the  precise  specification  of  the  interval  of 
integration  in  moment  detection. 
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In  this  section,  the  probability  of  error  in  detecting  a  single  pulse  by 
specifying  the  temporal  moment  of  any  order  •will  be  investigated,  for  the  case 
■where  no  filter  precedes  the  moment  detector  and  in'tersymbol  interference 
(pulse  overlap  or  cro\«llng)  is  absent.  It  is  assumed  throughout  this  memoranduia 
that  the  noise  is  stationary,  additive,  white  and  normal  with  zero  mean. 

The  process  of  moment  detection  in  the  presence  of  noise  is  equivalent  to 
passing  both  the  signal  SCtJ  and  the  noise  n(t)  through  the  filter  shown 
in  the  sketch  below. 


- ^ 


S(f)  -h  n(t) 


(t)  given  by  (1.1) 

/  limR  FILTER  \ 

I  representing  I 

\  MOMENT  DETECTOR  / 


Thus,  the  output  of  the  filter  at  tine  T  due  the  signal  is 


set)  (T-t)  dt 


set)  t 


4 


dt 


and,  similarly,  the  output  at  time  T  due  to  the  noise  is 

f^(T)  =  [  n(t)  dt  = 

Jo 

where  and  m  ^  are  the  A  th-order  tenqjoral  moments  of  the 

signal  and  noise,  respectively. 
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Designating  the  noise  power  density  (or,  noise  power  per  c»p«s.  of  one¬ 
sided  bandwidth)  as  ,  the  variance  6'^^  of  (equal  to  the  mean 

of  '^4^  >  since  E  |  -  O  )  can  be  eTqDressed  as  the  integral  of  the  nower 
density  spectrum  of  W  as 

I  I  where  =  /  h^ft)  e~'^  dt 

i/-  y-oo 

or,  by  Paraeval’s  theorem. 


*  2 


h^(t)  dt 


(1.2) 


Substitution  of  Equation  (1.1)  in  (1.2)  yields’ 

zA  +  i 


= 


Nr,  T 


2  2  A -hi 


(1.3) 


Equation  (1*3)  can  also  be  obtained  as  follows  i 


=  J'  J  ^  n(u)^  dt  du. 


T  rT 


O  ^  0 


(t~u)  dt  du. 


f  t^€(t~u,)<£t=a-^  Co  <  u  <  T) 


"  I  a-*  du  =^0  ^ 


zA  +  i 


-2 


2A-I-  1 
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Since  the  probability  density  of  the  noise  is  assumed  to  be  gaussian,  the 
probability  density  of  is  also  gaussian.  If  it  is  assumed  that  signal 

pulse  is  independent  and  occurs  with  probability  l/2,  it  is  easily  seen  that 
lowest  probability  of  decision  error  occurs  if  the  decision  threshold  is  set 
at  /2  .  The  probability  of  an  error,  P^.  ,  is  then 


26-, 


dm  A  = 


/7P 


'^4 


or,  since 


-  V 


e  dv~=  — —  f 


= 

2 


;diere 


Pe 


- 


(l.ii) 


(1.5) 


anJ  the  error  function  is  defined  by 

^  ^  /  S’  drr. 

Substituting  Equation  (1.3)  into  (1.5)  yields 


^4  = 


Ma 


2T 


'24  +  f  ' 


(1.6) 


Equation  (l.U),  with  given  by  (1.6),  is  the  general  formula  for  the 

probability  of  error,  which  is  seen  to  depend  on  the  signal  shape  through  the 
presence  of  in  (1.6). 
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Consider  signal  pulses  of  the  form 

S(t)  -  Ui  for  0  <  t  <  r  a  k  0) 

■  0  elsewhere 

and  let  £  be  the  average  signal  energy  per  syidral*  Then 


(1.7) 

(1.8) 

(1.9) 

(1.10) 


or  the  same  as  that  obtained  with  coherent  matched  filter  detection  of  unoorre- 
lated  symbols  {^  />  m  q  aueh  as  frequency-shift  keying.  (See  Reference 
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In  fact,  the  impulse  response  given  by  Equation  (1»1)  is  also  that  of  a  matched 
filter  to  a  signal  of  the  shape  given  by  (1.7)  with  c  ^  A  ,  It  follows  that 
this  signal  shape  is  the  optimum  for  detection  by  the  A  fh  moment  and  (1.12) 
gives  the  lowest  possible  error  rate  in  detecting  any  order  moment. 

Instead  of  Equation  (1.11),  can  also  be  expressed  in  terms  of  the 

average  signal  height.  The  average  signal  height  is 


Combining  this  and  (1.8), 


1  -h  i  _ 

{2(11717 


a  ff^ 


(l.llt) 


Substituting  in  (1.11), 


(1+  i)  i2A  +  / '  _  rr 

2(Ai-1  f  l)  ^  /  No 


(1.15) 


which  shows  the  expected  result  that  for  a  given  value  of  a/ {Nq  '  the 
probability  of  error  decreases  as  T  and  I  increase  (except  that 
is  independent  of  i  ).  It  must  be  realized  that  for  constant  a  increasing 
c  t  7“  or  both  i  and  "f  will  result  in  increased  energy  per  pulse. 

For  this  reason,  it  is  felt  that  the  perfnimance  of  digital  systems  is  more 
meaningfully  portrayed  by  the  functional  dependence  of  error  probability 
(which  is  related  to  through  Equation  l.U)  on  E/Nq  than  by  the  dependence 

on  a/N  where  N  is  the  r.m.s.  of  the  noise.  The  latter  approach  is,  however, 
used  in  Reference  1. 
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Moment  Detection  of  Miiltlple-PulBe  OroupB 

This  section  will  illustrate  how  to  investigate  the  probability  of  error 
in  detecting  words  contalrel.ng  more  than  one  signal  pulse.  For  simplicity, 
only  symbols  containing  two  signal  pulses  (each  of  duration  Tf,  )  with 
duration  T  •  2Tp  will  be  considered. (The  extension  to  longer  pulse 
groups  is,  at  least  in  principal,  straightforward.) 

Suppose  the  pulse  shape  is 


Sit) 


a 


■  0  elseidiere 


r  for  0  ^  t  <  (l  >  0) 


(2.1) 


Then,  by  (1.9), 


2  (2i  -h  t) 


(2.2) 


The  4  th-order  signal  moment  of  word  (1,  0),  corresponding  to  the  presence 
of  the  first  pulse  and  the  absence  of  the  second,  is 


a.; 


-  '^P 


^2(2i-r  I ) 


ET^ 


4-rI 


■r  i 


(2.3) 


The  4.  th-order  signal  moment  of  word  (0,1),  coriesponding  to  the  absence  of 
the  first  pulse  and  the  presence  of  the  second,  is 


(0,  f) 


ai  -=-[■  dt 
P 


tJ  '^2(2'-n-l)ETp  T  - - - 

^  E  rJ  (A-  r)!  f  -n  1  -f-  i 


r  =  o 


(2.h) 
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Thus,  the  expressions  for  the  zero-order  and  first-order  signal  raoiaentB  of  the 
four  possible  words  are; 


Mq(O,0)  = 

M  1(1,0)  - 

Ml  (1, 0)  = 

Mod,  f)  = 


/ 


M^(0,0)  =  0 

Mo(o,d  =  {iriFTTTEf^ 

Tf,  i’WTToTFp 

Mo  (1,0)  Mo(0,l) 


2 -h  i‘ 


/jtjtttjtt;’  jf. 


(2.5) 


M,(/,  1) 


M,(1,0)  *■  M,(0,  0 

r,  fnJTToTF;  (y^r  ^  jfj) 


Let  and  /r?,  be  the  zero-order  and  first-order  noise  moments.  These 

moments  have  zero  mean  and,  by  (1.3)  with  T  »  2Tp  ,  the  following 
variances; 


'S'/  =  %  Tp 


-  ± 
-  3 


NoTp 


(2.6) 


We  will  investigate  how  the  decision  as  to  irtjich  signal  was  most  likely  to  have 
been  sent  is  to  be  made  in  terms  of  the  observed  moments,  =  Mq  -h  n^o 
and  =  M f  y  rn^  ,  In  order  to  do  this,  and  to  find  the  best  decLsion 

rule,  we  must  know  the  Joint  probability  density  function  md  •  The 

marginal  probabllj  ty  density  functions  are  known  to  be 


^(f^o) 


. ' _  ^  - 

{Tn&o 


and 

/  "  Zests',  ^) 

-  e  '  / 

'jZTT  (7> 


p(m,')  = 
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It  is  more  convenient  to  have  the  density  functions  in  the  normalized  coordinates 
%  and  . 


_ 


^  - 


m, 


{T  / 


0  'P 


ni, 


(2.7) 


Thus,  the  marginal  probability  density  functions  become 


TW 


(2.8) 


If  and  A?,  were  statistically  Independent,  their  covariance  would  be 

zero  and  the  joint  probability  density  function  ^  (  <$  ,  >;?  )  in  the  normalized 
coordinates  would  be  ^  (  <§  )  •  ^  (  )^  )  or 


fi  (i>  = 


_J_  -r^/2 


2-n: 


2TT 


However,  the  covariance  ^  of  and  is  not  zeroj  in  fact,  it  is 

given  by 


r  ~i 

r 

/t  =  £■  ^  E 

/  n(t)  dt 

/  un  (u.)  r 

Jo 

Jo 

u  E  n(t)  n(u.)  att  alu. 


f,2r^  p2Tp 

j  J  U-^  &(t-u)  ait  oCu 


u  d  tj.  = 


(See  also  footnuoe  on  pg.  5) 
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The  cor.-elation  coefficient  of  ^  ^  normalized  covariance  of 


and  )  is 


^  [4 


{T 


(2.9) 


So,  the  random  variables  and  have  a  strong  linear  dependence  and  the 

joint  probability  density  ^  (  4 »  ^  )  takes  the  form 


I'l. 


(2.10) 


vhere 


(2.11) 


The  distribution  given  by  Equation  (2,10)  is  seen  to  be  in  accord  with  (2.8)  and 
(2.9)}  since  it  yields 


f\  OO  n  OO 


^r?p(^,/^)  d^dr^  -  fi 


'  -  ac  i/  -  OO 


The  joint  probability  density  ;£)  (  4.^  )  given  ty  Equation  (2,10)  is  seen 

to  be  ^mmetric  with  respect  to  axes  inclined  1*5°  with  respect  to  the 


Vf  ~  J~3~' 


Let 
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) 


Then 

4  =  ~</f)  ^  ^ 

so  that 

j  ■i 

^  2C/^yaJ  Z(t-/i) 

Thus,  lines  of  constant  or  constant  Q(x,,<^,)  are  ellipses  with 

major  and  minor  axes  coincident  with  the  x,  and  axes.  That  ie,  y, 

are  independent  normally  distributed  variables  with  zero  mean  and  unegual 
variances.  ' 

If  we  now  change  the  scales  of  Xf  and  t/f  such  that 

Z,  =  {2(f-h/)?  X  and  y,  =  '{T(T^~^  y  , 


then 


Q  =  X' 


2 

y 


(2.12) 


and  the  lines  of  constant  become  circles.  a:  ,  y  are  now  Independent 

nonnally  distributed  variables  with  zero  mean  and  equal  variances. 


The  transformation  from  4;  ^  y  characterized  by 

4  -  {TT^  X  ~  {T^<J  ,  f  /  {1-^' y  (2-lii) 


3(X,y} 


(2.15) 
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Let  R  be  a  region  in  the  t,  t  ^  plane  and  R  '  the  corresponding  region 
in  the  x  ,  y  plane.  Then  the  probability  that  ^  ^  lie  within  R 

equals  the  probability  that  Z  ,  y  lie  within  R  '  • 


P  = 


.  J  J 


and,  by  Equations  (2.10),  (2.12)  and  (2*lS),  can  be  expressed  as 


(2.16) 


For  yO  ■  ,  Equations  (2.13)  and  (2,lii)  become 


a:  = 


4  = 


2 


-1 —  ^  i-1—  y 


(2.17) 


(2.18) 


So  far,  we  have  been  concerned  only  with  the  stochastic  variables  due  to  the 
noise  with  E( z ,  y)  ^  (0 ,0)  »  We  must  now  determine  Ef^(z,y)  from  (2.5) 
for  each  of  the  four  possible  transmitted  words.  On  the  assumption  that  these  vrords 
are  a  priori  equally  probable, the  z,^  plane  is  then  divided  into  four 
decision  regions.  It  is  clear  that  the  lowest  probability  of  error  will  be 
attained  if  the  four  regions  in  the  ,  y  plane  are  chosen  such  that  every 
point  in  region  r  is  closer  to  the  corresponding  £^(z,i/)  than  to 

E^(z,i/),  r  ^  5  •  r*,  5  ■  I,  II,  III, TV.  The  decision  regions  are 

readily  determined  in  the  x,  y  plane  and  can  be  mapped  to  4  ,  ^  and 
Mf  planes  by  means  of  Equations  (2.18)  and  (2.7). 
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When  the  signal  moments  given  by  Equation  (2.5)  are  also  normalized,  by 
substituting  Mq  for  or  Mf  for  in  (2,7),  they  become 


^(0,0)  " 

^ (0,0) 

=  Q 

^(0,  1) 

-  ilt 

^(1,0) 

/ 

Z-hl 

^(0,0 

,  /r 

{l^l  2^l) 

v/,o 

xiT- 

2 

1  i-  L 

^(t,0 

.K_ 

A  _2 

A 


When  the  four  points 

^^(o,  I)  ’  ^(0,  rj  ^  ' 


and  17 


representing,  respectively,  the  expectations  of  the  four  possible  words  (0,0)  , 
(f,0)  ,  Co,/)  f  and  (l,/)  in  the  4  ^  -system  are  transformed  to  the  K  y  - 
system  by  (2.17),  they  become 


^  ^^-(0,0)  »  yco,o)^> 


,  etc 
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^(0,0) 
(1,0) 
^0,0) 
^(0,  f) 
^(0,  D 
i) 
f) 


From  theee  coordinates,  one  obtains  the  length  (in  the 
points  I  and  17  as 

^  =  /  K,.o "  ' 

_  y  /;  (i6  t  1(,i  +  /TTT  /  ' 

(i*-i)(2fi)  1  No 

and  the  length  between 


•  ^  fOt  -f-  J  ^ 

‘  (ti-C)^(2*  i)^  jNo 


points  II  and  III  as 
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X  y  -system)  between 
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II  III 


(y 


(O,  1)  ~  ^(f,0) 


)■ 


One  also  observes  that 


and 


'^(1,0)  *'  “  V(,,  i)  > 


therefore,  the  two  lines,  I  TV  and  II  III,  bisect  each  other.  Obviously,  both 
the  above  lengths  are  maximum  when  1^0  .  For  i  •  O  ,  the  slope  of 
line  rfv  is 


2-(T 

2i-{T 


-(2-  fT); 


while  the  slope  of  line  ll  III  is 


^(0,  t)  '  ^(t,0) 


/ 

2-{T 


for  ar^r  i  . 


Thus,  since  the  product  of  these  two  slopes  is  equal  to  -1,  the  two  lines  are 
also  mnt'ually  perpendicular  ^en  i  •  0  ,  Consequently,  the  case  with 

i  0  (corresponding  to  rectangular  signal  pulses)  has  the  four  points 
located  farthest  apart  and  will  have  the  lowest  error  rate  when  the  best  decision 
is  made.  From  now  on,  we  will  only  consider  this  case.  Then,  the  lengths  I  TV 
and  TI  rcT  become 

rfV  -  and  II  III  -  /j  ’ 

I  ^0  '  ^0 
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The  boundaries  of  the  best  decision  regions  are  formed  by  segments  of  the  per 
pendicular  bisectors  of  lines  I  III,  III  IV,  IV  II,  II  I,  and  II  III  as 
indicated  in  Figure  2.1. 
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We  have  been  unable  to  obtain  a  closed  fonn  expression  for  the  probability 
of  error  when  the  optinum  decision  regions  are  used.  However,  we  have  obtained 
closed  form  expressions  for  both  an  upper  and  lower  bound  of  this  probability. 

The  results  are  derived  below  and  plotted  in  Figure  2tU*  It  will  be  noted  that 
the  lower  bo\ind  corresponds  to  the  error  probability  obtained  with  matched 
filter  detection  of  unoorrelated  binary  signals.  In  this  case,  each  pulse  has 
a  probability  of  error  (Reference  2). 

(2.19) 


and  the  probability  of  a  group  of  two  pulses  to  be  in  error  is 


(2.20) 


Now,  consider  the  hypothetical  case  shown  in  Figure  2.2.  Here,  the  decision 
regions  indicated  by  the  dashed  lines  are  similar  to  Figure  2.1  but  points  II 
and  III  have  been  moved  farther  apart  to  II'  and  III'  so  as  to  form  a  scjuare 
with  points  I  and  IV.  According  to  Equation  (2.16),  the  probability  of  a  correct 
decision  for  this  case  is 


and,  hence,  the  probability  of  error  is 

I 


Figure  2,2 


Therefore,  the  probability  of  eiror  of  the  actual  case  shown  in  Figure  2.1 
must  be  higher  than  ,  Next,  consider  the  case  diown  in  Figure  2,3. 

Here,  the  locations  of  the  four  points  are  the  same  as  in  Figure  2,1  but  the 
boundaries  of  the  decision  regions,  as  indicated  by  the  dashed  lines,  are 
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slightly  different  from  the  optimum.  Consequently,  the  probability  of  error, 

,  for  the  boundaries  shown  In  Figure  2,3  must  be  higher  than  that  for  the 
boundaries  of  Figure  2.1,  Ey  (2.16)  and  (2.21), 


'fi^amiCAL  mmiAmm 


lA 


?? 


3 


^gure  2,9 


,  a  leva,  bound,  and  ^  '‘"d  p 

«  =m.r  V..  f/  ;  J  uppe,  •«  pi„ 

,  «PMW.d  i„  d.oip,j,_  “"■>  «»pectl,.ij,  to  toe 

“'■11''  •«  deehee  °”*°  ‘'“  />/,  7’T''  «■=«  . 

»"  ..  ttoee  r  "r  “ 

1"  >o»»„iat  Involve-  „  ^ '““‘’"-’mWbi 
■  «  •!  (Kef. 


PROBABILITY  OF  ERROR 


Figure  2.  4 
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use  the  boundaries  shown  in  Figure  2.6;  a  decision  circuit  for  these  boundaries 
is,  of  course,  considerably  easier  to  build.  In  computing  the  probability  of 
error,  Slade,  et  al,  treat  and  as  statistically  independent.  It 

is  of  interest  to  compare  the  results  obtainable  with  these  boundaries  to  those 
obtainable  with  the  optimum  boundaries  and  to  examine  the  effect  of  treating 
and  as  statistically  independent. 


When  mapped  to  the  y  plane,  the  decision  boundaries  ^own  in  Figure 
2.6  appear  as  the  heavy  lines  shown  in  Figure  2.7.  Let  be  the  conditional 

probability  of  error  given  that  either  word  (0,0)  or  (1,1)  corresponding  to 
points  I  and  IV  was  sent.  Then 


1 

F 


( 


1  -  (frf 


Z 


(2.2I;) 


Let  be  the  conditional  probability  of  error  given  that  either  word  (1»0) 

or  (0,1)  corresponding  to  points  II  and  III  was  sent.  We  have  been  unable  to 
obtain  a  closed  form  expression  for  ^  .  However,  we  will  find  an  upper 

bound,  ,  and  a  lower  boTind,  .  ,  for  .  The  lower  bound 

is  obtained  by  changing  the  straight  line  AB  to  the  broken  line  123U  and  com¬ 
puting  the  conditional  probability  of  error  given  that  word  (0,1)  corresponding 
to  point  TIT  was  sent.  Thus, 


That  the  contributinn  of  the  triangular  area  A  1  C  is  less  than  that  of  tidangular 
area  C  2  D is  easily  seen  by  comparing  the  contribution  of  triangular  area  A'l'C 
to  that  of  ai'ea  C  2  D  and  noting  that  A'l'C  is  the  mirror  image  of  A  1  C  about 
the  line  IIIC, 
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Figure  2.7 


TECHNICAL  MEMORANDUM  NO,  1\ 


28 


3  January  1961 


The  upper  bound  is  obtained  by  considering  the  line  A523U  as  the  boundary  and 
again  computing  the  conditional  probability  of  error  given  that  word  To,!) 
was  sent.  (The  segment  5  to  2  is  an  arc  of  a  circle  with  radius  ^ / 5/A/p 
and  center  at  point  III.)  Thus, 


p 


_  X_L 
-4  r^l 


tf-'**  zrC  roLr 


J_ 

TC 


'-iiW, 


- 


VW7JT 


(2.26) 


f 


The  probability  of  error  py  averaged  over  all  h  vrorc's  is 


Define 


Then 


(2.27) 


where,  bj'  (2,2)i)  to  (2,26), 


^sc  =  T-T  4 


N, 


-f  erf 


rf  (2-28) 


€ 
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1 

1 


_  ^  _5 
e  76  % 


(2.29) 


and  are  plotted  in  Figure  2.U.  The  probability  of  error  ^  based  on  the 
assumption  that  and  are  statistically  independent  is  also  plotted 

for  comparison  on  Figure  2.U.  From  Figure  2.6  it  is  seen  that 


(2.30) 


-  if^)  - 


(2.31) 


(2.32) 


It  is  interesting  to  note  that 
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On  Figure  2,k  the  upper  and  lower  bounde  to  obtained  with  the  optimum 

decision  boundaries  are  also  plotted.  It  will  be  noted  that  the  difference  in 
db  between  the  optimum  and  the  aijqsle  (Figure  2.6)  decision  rules  amounts  to 
approximately  U  db  for  >  12  db.  This  difference  corresponds  to  about 

lOOil  ratio  in  error  probability  at  B/N^  ■  13  db  and  this  ratio  increases 
without  limit  as  B/n^  Is  further  increased. 
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3«  Effect  of  a  Filter  Preceding  the  Moment  Detector 


This  section  will  illustrate  how  the  probability  of  error  will  be  affected 
if  a  filter  precedes  the  moment  detector*  The  filter  to  be  considered  has  the 
simple  low  pass  frequency  response 


IV+J-f 


(  iv  being  the  3  db  bandwidth)  and,  consequently,  its  impulse  response  is 


h(t)=.  27t  for  t  >  0 

=  0  for  t<0 


The  variance  of  nt^  may  be  written 

aT  i%T  r-  —I 


(3.2) 


nt^u.'*  du.  dt 


where  (  t-U  )  is  the  noise  autocorrelation  at  the  output  of  the  filter. 

Since  the  noise  power  density  spectrum  at  the  filter  output  is  |  , 

one  has 


(3.U) 


^  A/  ,  -zntvU-ii\ 
=  —  N  W& 

2  0 


Substitution  of  (3.li)  into  (3.3)  yields 
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].  cLt 

Thus,  by  performing  the  Integrations,  one  obtalnst 

Z-KWT  ^  (zitWT)^' 

JZ'K  WT)^  ’JInWfpy 


-{, 


•narfiyr 


^s  \  1  i  1  .2  1  ^  1 

k  ^  [s  2  27e^T  7  IrtTvJrp 

^ (2  7€  wT)^  ^  (2n  k/r)* 

1  ^  -znwr  1 

(2n  WT)‘  J  J 


■h  ^ 


(3.5) 


(3.6) 


(3.7) 


(3.B) 


As  tvT  — ►  oo  the  variance  Is  asys^stotic  to  the  white  noise  value  given  by 
(1.3).  This  result  is  not  surprising,  slncej  on  the  one  hand,  if  we  hold  T 
fixed  and  let  k/ — »►  <x>  the  effect  of  the  filter  disappears!  o*'  other 

hand,  if  we  hold  fixed  and  let  T — ►  ew  the  effective  bandwidth 

of  the  filter  representing  the  moment  detector  (see  Section  1)  approaches  zero.* 


-  =  -n^  '’’4  (o'!  ““ 

/OP 

(t)  dt  ,  for  h^(t)  given  by  (1.1)  one  obtains  \/^-  • 
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For  the  present  application,  the  most  important  effect  of  the  filter  is  to  add 
an  exponential  decay  to  an  original3^  tine-limited  pulse.  By  proper  choice  of 
the  transmitted  signal,  however,  it  is  possible  to  obtain  a  signal  at  the  output 
of  the  filter  of  United  duration.  Thus,  the  Input  signal  5^  (t)  shown  in 
Figure  3*1  results  In  the  output  signal  \  shown  in  the  sane  figure. 


one  obtains 


Using  (3.2)  and  the  relation 

5^  (i):t  I  5^  (rl  h(t-v)  Civ, 

'•'-oe 

5jt)-  lor  0  ^  t  4  e 

•  A  e^t^(T-e) 

(j.e)  T 


(3.9) 


0  elsevrtiere 
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The  optimum  value  of  &  ,  i.e,,  that  value  of  S  which  results  in  the  lowest 
probability  of  error  for  a  given  pulse  energy,  is  a  function  of  peak  ainplitude 
4  ,  filter  bandwidth  tv  and  symbol  duration  T  *  Since  the  input  pulse  shape 
(Figure  3,1)  cannot  match  the  Inpilae  response  of  the  fllter-aero-moment  detector 
combination  (except  in  the  limit  ae  w — ►<*  ),  it  follows  that  this  system  will 
have  a  higher  error  probability  with  the  filter  than  without  it  if  rectangular 
pulses  are  used.^ 


For  the  case  of  $  ■  t/z  ,  it  is  easily  shown  that  the  performance  degradation 
exceeds  3  db.  lUius, 

£  -  average  energy  per  input  signal  (It  can  bo  shown  thatfor  Figure  3*1 
the  average  energy  per  output  signal  is  eqpxal  to/£-  )  r 

'  hr  ' 

where  £  is  the  average  energy  per  input  signal,) 


-r(5„(tA  dt 

•'o  ^  -^3=7/2 


X  =  Jet 

_  *  -rnrivr  f 


ZfT 


tL—  r 

'^^0  L 


By  (1,5)  I  (Tg  given 
i-e 


by  (3.6) 


fi 


-he 


-ZTth^T 


f  -t-g  -i-KurJ 


/ 


•f/V. 


Z7t  WT 
(Equal  sign  for  WT—>oe) 


and  the  probability  of  error  with  the  filter  present  is 

X^)  [By  (l.U)] 

where  /|  is  the  probability  cf  error  withooit  the  filter  as  given  by  (1,12), 
which  is  valid  for  aero-order  moment  detection  of  unfiltered  rectangular  signals. 
Thus,  it  is  seen  that  for  the  same  probability  of  error,  the  E/Ng  ratio  for  the 
case  with  the  filter  must  be  more  than  twice  Uiut  for  the  case  without  a  filter. 
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)u  Effect  of  Pulse  Overlap  (Intergymbol  Interference) 

When  there  exists  a  minimum  duration  below  which  the  signal  pulse 

duration  cannot  be  reduced,  higher  signalling  speeds  can  be  achieved  only  by 
overl  apping  the  pulses  such  that  T  <  >  y/heve  T  is  the  time  between  two 

adjacent  pulses,  as  well  as  the  interval  of  moment  Integration!  It  Is  clear 
that  under  these  conditions,  interssnubol  interference  Is  unavoidable.  In  this 
section,  the  deterioration,  as  measured  by  the  Increase  in  error  probability, 
will  be  investigated  for  a  simple  case  in  which  the  pulses  are  triangular  in 
shape  and  the  decisions  azo  based  on  zero-order  moments  in  \dzieh  case  closed 
form  reszilte  may  be  obtained. 


T 

T 

T 

T 

T 

Figure  li.l 

The  assumed  pulse  shape  and  nomenclature  are  illustrated  on  Figure  h.l.  The 
reference  pulse  is  shown  by  the  heavier  solid  lines.  Hie  origin  of  V  ,  the 
time  variable  which  describes  the  pulse  shape,  is  chosen  such  that 
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■'(r)  = 


a  ~~  for  O  ^  T  <  AT 

<  r  < 


(U.i) 


'Where  /'  Is  the  value  of  -f—  'when  the  triangular  pulse  attains  its  peidc 
value,  a  .  The  interval  of  moment  integration  of  duration  T  starts  at 
T  •  Tq  .The  pulses  shown  by  the  lighter  solid  lines  are  oalled  "‘the 
possible  preoeding  pulses"  and  are  the  possible  pulses  preceding  the  reference 
pulse  which  cover  a  portion  of  the  specified  Interval  of  moment  integration* 
Similarly,  the  dashed  lines  show  "the  possible  succeeding  pulses"*  All  other 
pulses  are  entirely  outside  the  specified  interval  of  Integration  and  are  not 
shown  in  Figure  1;*1*  Let  Np  and  b^  respectively,  the  mmber  of  all 

possible  preoeding  pulses  and  all  possible  succeeding  pulses*  Then,  Np  and 
are  Integers  satlsf^ng 


-!}r(rp-Ta)-  f  ^  Np  <  -^  (Tp  -  Tg  ) 


(U.2) 


and 


T 


^0 


«  /Vc 


< 


J_ 

T 


To  +  f 


(U.3) 


respecti'vely* 


Let  Mq  ,  Mp  and  Mr  be  the  zero-order  moments  contributed 
respectively  by  the  reference  pulse,  all  possible  preceding  pulses,  and  all 
possible  succeeding  pulses.  Then,  for  T^  <  ATp  and  Tq  +  T  >  ATp  , 


i-(T.^r-AT^ 


Tp-(Tgi-T) 
(1~A)  Tp 


:AAil-A) 


(ll.lj) 
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(U.6) 


and)  hence I  the  total  eontrlbation  of  all  possible  preceding  and  succeeding 
pulses  is* 


Figure  U<2  is  a  (hypothetical)  sketch  of  the  probability  density  distilbutlon 
or  the  observed  aeioth  moment  due  to  signal  on  the  assusption  that  the  pulses 
occur  Independently  with  probability  i/i  *  It  consists  of  two  identical  sym¬ 
metric  parts,  each  of  which  consists  of  (N_  +  N.  +  1)  delta  funotions  of 
strength  1/  {2(Np  ^  +1)|  .  The  location  of  eaoh  delta  function  corresponds 


Figure  h.2 


One  reason  for  the  choice  of  tr1ang>ilar  pulses  for  this  analysis  was  that 
Mfj  ,  are  independent  of  Np  ,  A/j.  with  this  shape. 
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to  a  particular  combination  of  presence  and  absence  of  the  reference  pulse 
and  possible  preceding  and  succeeding  pulses. 

If  it  is  desired  to  make  each  decision  independently  (clearly,  succeeding 
moir<ents  are  not  independent  when  overlapping  pulses  are  used),  the  optimum 
threshold  is  at  |  (M^  +  M^')  .  We,  therefore,  adopt  the  decision  rules i 

measured  value  of  zeroth  moment  >  *  (M.  ■*•><.)  •••  reference  pulse 

2  ®  ®  present  (U.8) 

measured  value  of  zeroth  moment  $  i  (M^  +  M^j*)  ...  reference  pulse 

absent 

Since  the  number  of  the  actual  preceding  and  succeeding  pulses  may  vary  from 

zero  to  (N_  N.  ),  the  moment  due  to  the  actual  preceding  and  succeeding 
P  ®  I  ft  » 

pulses  may  be  less  than  and  is  designated  is 

measured,  not  .)  Thus,  with  the  reference  pulse  actually  present,  an 

error  will  be  committed  when  the  noise  moment,  ,  is  such  that 

Mo  *  «o"  "  ^  ^  7  ^”o  "  «o'^ 
or 

*  ®o"l 

Similarly,  with  signal  actually  absent,  an  error  will  be  committed  when 

-Mo')  "  2  (M^’  -M;’)]  (U.IO) 

From  the  fact  that  and  (M^'  -  M^^")  have  the  same  possible  values  (wliioh 
have  been  assumed  to  be  equally  probable),  (U.9)  and  (ii.lO)  show  that  the 
probability  of  error  is  the  same  when  a  signal  is  either  actually  present 
or  actually  absent.  In  other  words,  the  probability  of  error  can  be  cal¬ 
culated  as  follows;  first,  by  (1.6), 

[  (M,- m;  ) '  ^ 


(U.il) 
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for  each  possible  will  have  repeated  values  if  M*'  has  repeated 

values) j  then,  by  the  use  of  (l.U),  the  probability  of  error  is 


where 


(U*13) 


is  the  nuntoer  of  possible  or  • 

From  (U*ll)  and  (li.l2)  and  noting  that  zero  is  a  possible  value  of  , 

one  can  see  that  it  is  desirable  to  have  ~  )  as  hl^  as  possible.  From 

(U.li)  and  (U»7)>  one  finds  that  is  naxlmum  and  1^'  is  mlnlnum  \dien 


T,  •  A  (Tp  -  T) 

Therefore,  we  choose  this  value  for  7^  .  Then  (U.h)  and  (h*7)  yield 

It  follows  that  (M,  ~  t/i I  )  decreases  from  to  zero  as  -f-  decreases 

from  /  to  ( /  -  ^  ^ 


If  ^  (i.e.,  there  is  no  overlap),  "  AfJ'  s  Q 

from  (h.l?),  (h.ll)  and  (It. 12)  the  simple  expression  for  the  probability  of’ error 


and  one  obtains 


^  2  ^  ^ ^  j ^  ^ 


(li.l6) 


or,  since  the  average  signal  energy  per  signal  for  the  present  case  is 


AT 


'(t-A}r 


f  t 
I  0-4)t\ 


di 


i-  o 


-1  a^'J, 
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—  _L  ^  1 _ _  ..r  f 


f  Cf-e.rf 
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For  the  case  vith  ~  "z  *  ^  ~  I  ^  ^  * 

(X-/v?;;=  /  ar  [ByCt.is)) 

M;  -  0,^aT,  ^uT  and  ^  a’' 

('X-X-l  ^u.T.^a.r  and  a.r 

*• '  i/T’  7/T>  iK 

'I  ■  f  ^  j  d-erf  ^  fTTK) 

O-erf  i  C4,12)  ] 

-  i  ■&  ^  K  "  *'•’'  f  /r^  (I..16) 

^^tI/  *‘^1  f  ^  ^7"  /T 


/;  •  i  'W/X  ^ 


(U.19) 


For  the  case 
results  are  obtained: 


^  -i  ,  4  ./  md  i  -  i 


,  the  following 


p,  ■  j  -  s  (^rf  ne^r  §‘f£ ,  ^rf  )  (1,.20) 


£  a  dltaT 
zta 


(ld.21) 


t;;c'!>'igal  kemora.ndum  no.  ia 
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The  probabilities  of  error  given  by  {1;.17),  (4.19)  and  (4.21)  are  plotted 
in  Figure  4.3  versus  £■'%  expressed  in  decibels.  The  effect  of  overlap 
on  the  error  probability  is  thus  made  clear.  For  the  cases  "^/Tp  <  /  >  I't 

may  be  noted  that  the  error  probabilities  shovm  in  Figure  4.3  are  the  average 
values  for  all  possible  situations  and  that  the  conditional  error  probabilities 
at  high  nay  be  as  high  as  four  tines  for  the  following  two  particular 

conditions:  (a)  the  reference  pulse  is  present  and  all  possible  preceding  and 
succeeding  pulses  absent j  (b)  the  reference  pulse  is  absent  wid  all  possible 
preceding  and  succeeding  pxilses  present. 

It  is  of  interest  to  compare  the  results  obtained  above  with  those  of 
SJade,  et  al  (Ref.  1).  Slade,  et  al,  investigated  the  effect  of  pulse  rate 
on  error  probability  in  detecting  output  pulses  of  an  ideal  low-pass  filter 
of  one-sided  bandwidth  .  But  they  neglected  the  effect  of  the  filter 

on  the  variance  of  noise  moment  so  that  (1.3)  was  assumed  to  hold  •  The 
output  pulses  they  considered  have  the  shape  shown  below, 

to.  ^ 


with  so  selected  that 

iw  ^  ^  ^ 

V  A'  i  ^ ' 

"By  substituting  m  for  'K, 
of  Ref.  1, 


(no  pulse  overlap) 
(with  overlap) 


) 


>  (4.2?) 


f 


(1«3)  becomes  the  came  as  Equation  (19) 
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H gure  4-3 
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TliPir  results  are  eotpressed  in  terms  of  ,  where  is  the  average 

pulse  amplitude  and  ^  is  the  r.m.s.  of  the  filtered  white  Gaussian  noise. 

V  is  the  total  noise  power  at  the  filter  output  (or  in  the  bandwidth  ) 

so  that  it  is  related  to  our  by 


(U.23) 


Our  equations  (It. 16),  (U.18)  and  (U.20)  for  triangular  pulses  are  readily  converted 
to  correspond  to  their  results  by  the  use  of  (lt*22),  (lt*23)  and  a,  , 

yielding 


P,-  j(/-erf  f  ^  fW)  for  T>  ^ 


(U.2U) 


^  Z  erf 

N 

5'fT 

5 

for 

T  = 

JL 

*  Z  erf 

# 

iz 

(ll.25 


(U.26) 


From  these,  the  following  table,  which  corresponds  to  similar  tables  in  the 
reference,  is  obtained  for  •  constant  ■  10"^, 
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hh 


2  TW 

Pulse  Par  Second 

20  log  jf- 

100 

-2.6 

20 

-iw 

10  ’* 

U.li 

10 

7.4 

k 

I'' 

11.4 

3 

-  w 

3 

12.7 

1 

14.8 

2 

3 

1 

2  W 

26.1 

1 

( 

J 


] 


no  pnlse 
oTtrlap 


poll* 8  overlap 


The  upper  part  of  the  table  (no  pulse  overlap)  agrees  exactly  with  Table  I 
of  Reference  1,  This  would  be  expected,  since  the  probability  of  error  in 
detecting  zero-order  moment  does  not  depend  on  the  pulse  shape  (It  depends 
only  on  )  when  the  pulses  do  not  overlap.  With  overlap,  however,  the 

>So///  values  given  in  the  lower  part  of  the  above  table  are  about  3.5 
decibels  lower  than  the  corresponding  values  given  in  Table  II  of  Reference  1. 
This  rather  appreciable  difference  is  probably  due  in  part  to  the  difference 
in  pulse  shape  and  in  part  to  the  choice  of  which  detezmilnes  the  location 

of  the  interval  of  moment  integration  with  respect  to  the  pulse  shape.  (The 
manner  in  which  was  chosen  is  not  described  in  Reference  1.) 
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IV(b)  DETECT  MEMO  NO.  U 

Subjsot:  "Optimum  Decision  Based  on  Multiple  Moment-Detection" 
By:  T.  T.  Chang 


Consider  the  problem  of  deciding  which  of  q  poesible  aignala  was 
actually  transmitted  when  the  only  available  data  consist  of  /a.  set  of  n 
temporal  momenta  derived  from  the  received  waveform  which  consists  of  signal 
and  stationary,  additive,  white,  Gaussian  noise.*  q  distinct  signals,  all 
of  equal  duration,  T,  may  be  transmitted. 

The  present  analysis  solves  the  problem  of  which  decision  rule  results 
in  the  smallest  probability  of  error  if  the  aeroth,  first  and  second  order 
momenta  are  available  (the  analysis  may  readily  be  modified  for  other  order 
moments).  Since  the  observed  moments  constitute  the  sum  of  the  signal  and 
noise  moments,  one  may  proceed  as  fellows i  First,  find  the  Joint  probability 
density  distribution  of  the  three  noise  moments.  It  is  convenient  to  think 
of  the  distribution  of  a  signal  point  in  three-dimensional  (moment)  space. 

Since  the  moments  are  not  independent,  an  orthogonal  transformation'*^  is  next 
performed  which  yields  the  probability  density  of  the  signal  point  in  inde¬ 
pendent  variablesj  these  variables  are  then  normalized  to  have  identical 
(Gaussian)  distributions.  Finally,  the  decision  is  made  by  comparing  the 
distances  in  this  space,  between  the  point  represented  by  the  observed  moments 
and  the  q  points  representing  the  q  sets  of  moments  of  the  possible  words 
in  the  absence  of  noise. 

Without  losing  any  generality,  the  stationary,  additive,  white,  Gaussian 
noise  may  be  assumed  to  have  zero  mean,'*'^  Sien  the  noise  temporal  moment  of 
any  order  also  has  zero  mean.  Let  m  ,  m.  and  nu  be  the  zeroth,  first  and 
second  order  noise  monents,  all  with°zero  mBan.*^  For  the  analysis,  we  need  to 
evaluate  the  following  quantities. 


*  Throughout  this  memo,  n  -  3  is  assumed.  The  extension  to  n  3  can 
be  carried  through  in  analogous  manner. 

■K-K-  See,  e.g.,  Middleton's  "Introduction  to  Statistical  Communication 
Theory,"  McGraw-Hill  I960,  pg.  3ii9. 

^A-y.-a  If  the  noise  has  a  given  mean  different  from  zero,  this  mean  can 
be  added  to  the  signal  in  computing  the  expected  moments  of  each 
Word  • 
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For  h  *  k|  the  quantity  la  the  Tarlanoe  or  nean  square  of  ai.  ]  for  hytk.  It  la 
the  ooTsrlanoe  of  a.  and  (We  avoid  the  tern  ■seoond  nMNmt  *  hare^  so  that 
we  oan  reserre  "nomnt*  for  "teaporal  »o»siit>  only.)  By  definition,  the  kth 
order  noise  moment 

^  fj t^nd)  Ji 

where  n(t)  is  the  noise  and  T  is  the  duration  of  one  word*  Thus, 

yi(i)  dt  uJ*  yi(t4.)  cJu'\ 

*=/  f  u.^  E  [ytd)  n(i^)]  du.  eft 

O  /c 

=  /  f  (u.- t )  cfu.  cf t 


Designating  the  noise  power  per  ops  of  one-sided  speotrum  as  H  ,  the  auto- 
oorrelation  of  the  noise  is  ° 


'ftn  Z  4,^ 


t ) 


eff 


Henoe, 

jJ UL^4>^^(U.^t)dLC  =  (0<t<  T) 


and 


A4 

2.  h  I 


(1) 
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From  this  ve  obtain! 


/“ao  =  -2^  ; 

/ 

II 

1 

3 

//o 

£ 

II 

3 

^M'zo 

^4- 

^  M-Z! 

We  now  form  the  matrix 

1 

"  H'oo 

H'ot 

H'oL 

- 

M'lO 

H'io 

H-ii 

H'li 

(2) 


(3) 


Using  the  elements  as  given  b7  (2),  the  determinant  of  ^  is  found  to  be 


/  A4,  T 


(  2^ 


so 


(U) 
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i 


and  the  Inverse  matrix  of  yU.  is  found  to  be 


where 


il 

)  -  JAP^ 

A' 7"? 

1  _  72  ^  \ 

^0!  Nf,  r* 

=  -/2^ 

/ 


^  ss  — :!££_  K ;; 


o;ci 

=  -/^V7j  .--4=- 


(6) 


Since  the  noise  is  assumed  to  be  Oaussianly  distributed,  the  noise  moments 
are  also  Oaussianly  distributed  and  the  Joint  probability  density  distribution 
of  any  three  noise  moments  of  different  orders  is  a  3-dlmen8ional  noimal  distri- 


h 


< 
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bution,  ^Consequantly,  the  distribution  of  m  ,  bu  and  nig  in  the  m  ,  hl,  ru 
space  ia^ 

(7) 

vhere 


2  ■*■  **  ^x  ) 


(8) 


Introducing  normalized  variables^ 


yrio 

/— 

yyxQ 

01, 

~ 

7K,  _ 

/At 

VJ  • 

m, 

0-,  ~  \l 

f-  V 

/ 

N, 

AT 

r* 

Then  the  Joint  distribution  of  ^  and  ^  in  the  ^  ,  p  ,  5  space  ie 

^  f  (yrio,  >n, 


^For  instance,  see  J.H.  Laning  and  R.  H.  Battin  "Random  Processes  in 
Automatic  control,"  19^6,  McOraw-Hill  Book  Company,  Eq.  (2.13-31)  on  p.  78. 
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or,  by  (7),  (2)  and  (li), 


/Z 


where,  by  (8),  (9)  and  (6), 


(10) 


(h) 


Our  next  step  la  to  find  a  linear  transformation 


1 

z 

y 

•[L] 

j  _ 

< 

(L  being  a  square 
aatrix) 


(12) 


which  transforms  (11)  to 


x.^  -f-y 


(13) 


30  that  X,  y,  z  are  orthogonhlized  normal  coordinates.  The  usual  way 
of  obtaining  this  kind  of  transformation  is  to  rotate  the  ? ,  ,  <? 

axes  to  the  principal  axes  of  the  central  quadric  siurface  represented  by  (11) 
with  R  equal  to  any  real  constant  and,  then , to  change  the  scales  of  the 
principal  axes.  In  doing  this  for  the  present  case,  however, 


*For  method  of  obtaining  the  principal  axes,  see,  for  instance,  F.  B.  Hildebrand 
"Methods  of  Applied  Mathematics,"  Prentice-Hall,  Inc.,  Article  I.I3. 
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fairly  ounbersome  numerloal  computations  are  enoountersdt  a  method 
described  In  the  APPENDIXi  the  foU'-wlng  transformation  has  oeen  obtained. 

L 

where 


The  correctness  of  (lli)  Is  readily  verified  by  substituting  (Ih)  Into 
(13)  to  obtain  (11).  The  Jacobian  of  the  transformation  (ll*)  Is 


■-  '/s' ^  Cf.b^  /2. 


(16) 


as  would  be  expected.^  Then,  from  (10),  (13)  and  (16),  the  joint  distri¬ 
bution  of  the  normalized  independent  random  variables,  X,  ,  y.  and  •? 

in  the  X.  ,  Y  *  f  speoe  Is  •  d 


■& y  )/Z 


Any  transformation  (12)  satisiying  (I3)  identically  for  R  given  by  (11) 
must  have  the  Jacobian  equal  to  12  to  cancel  that  factor  appearing  in 
(10),  since  (17)  must  be  true  for  such  a  transformation. 
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Let  the  signal  moments  of  any  word  i  among  the  q  poasible  transmitted 
words  be  «  {{..and  floi  (1  ■  1«  2,  'q))  and  let  the  observed  moments  be 

and  ^2'  lx  1  la  the  aotually  transmitted  word,  we  have 

(18) 

Substituting  (13)  In  (9)j  one  obtains 

Vi) 

where 

(20) 

(21) 

Substituting  (19)  in  (IL),  one  obtains 


and 


tr-- 


M, 


% 


ti. 
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I 

where 

X  ^  u -  2  ur)  \ 

Y^-b,(u.-hSuJ-)-i‘b^‘ir 
Z^CiioL-t^Soj-)-*- Citr  ) 

■=  ^  j 


<^~-P¥ 

^/.^638£'0/09 

tjte 

1- 

11 

^2.60Z3S29/7 

4  *M) 

-/3.8SS08b^O 

c,  -I¥(f-M) 

=  .Z9f3797¥<^^ 

'"Iw ) 

=  >/9/55iOZB3 

(22) 


(23) 


(21*) 


(25) 
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For  an  observed  set  of  moments  m.,  nu,  nu  corresponding  to  a  particular 
set  of  X,  y,  the  likelihood  or  that  wBrd  is  greatest  for  which 

2  2  2 

fi  -  (x  -  +  (y  -  y^)  +  (a  -  (26) 

is  a  minlnun.  Consequently!  the  optimum  decision  rulef  in  the  sense  of 
resulting  in  the  lowest  probability  of  error!  may  be  stated  as  follows. 
Designate  that  signal  J  as  having  been  sent  for  which 

f  j  ■  .in  (  f  J  . 

Implementation  of  this  decision  rule  is  probably  most  readily  achieved 
through  the  use  of  a  digital  computer* 


10 
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appendix 

Conalder  the  quadratic  form  of  three  variablee  « 

R  “  An  -s'  *■  A,t  -ei  ■*  Ati 

*2  (A, I  X,  +  A, I  X,  x^  V-  A^i  X,  X,  ) 


(ii) 


1 

) 


(A2) 


Then 


A,z^'--^2A,2&/3)y^  ‘i'AjsXxj 

^{£A,,A3-^^A,20i/5-^^A,2  (A/Z  ■^Bo<)jy;y^ 


^£A,sA  ■^^A^30<)^^Ji3  ■^r^A,sB 


y? 

A,  B,  o<  and  ^  ; 


*It  is  assumed  that  the  coefficients  satisfy  the  conditions: 

An  CA23  A^z  )  >3A,zAf3A23  ^ 
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6  «  -  B 

I  An 


5=± 


o(.^yA 


1  —  ^^3 
''  An 


V2 


VJ 


^2. 


Az  “*  Az 


>  (All) 


The  value  of  A  may  be  chosen  arbitrarily.  With  conditions  (Aii) 
satisfied}  (A3)  becomes 

where 

^  =  (A„  -f-  A^2  ^  2 A, 2  y)A" 

H  -  (£An  ^  2  )A 


{AS) 


(a6) 
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Let  y-j  ^  axes  which  are  obtained  by  rotating  the  y^^,  x^  axes  through 
an  angle  ^9  about  the  yg  axis,  where 

tcofo  20  -Z - ^  ^ 

so  that 

y,  f!  ■* 

and  (a5)  becomes 


where 

i,’- ^  K  *  ) 

Putt^g 

y=‘=^y,  /  = 

(A9)  becomes 


(AlO) 

(All) 

(A12) 
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From  (a2)j 

"  AiS-Bol  1 

From  (A8), 

V,  -  ihJyC'T^hr^ 

Combining  (All),  (Al3)  and  (AlU),  one  finally  obtaine 


y  -! _ : - 


In  applying  the  above  results  to 
y?  -f-  36^* 


(A13) 


(AlU) 


(A15) 


I 

J 


(A16) 
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it  is  found  that  the  tranafomatlon  Al3  permits  a  Bin?>le  geometric 
interpretation  If  we  take 


Then 


Ajj  *■  6A‘ 


and  conditions  (AU)  give 


If  we  choose  A  In  such  a  way  that 

we  obtain 

Hence, 

«  =  y^  A/s-s«=:§- 


and,  by  the  use  of  (A17),  equations  (A13)  give 


(A17) 


<A18) 


(A19) 


(A20) 
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The  geo»etrlo  Interpretation  of  this  tranaformatlon  la  that  the  7,,  yg 
axes  ape  obtained  first  inoreaeing  the  eoalea  of  the  ^  $  axee 

by  '/6  and  '/T  «  reapeotivelyi  and  then  rotating  these  axee  about  the 
Y  axis  through  an  angle  . 


Using  the  values  of  B 
obtains 


y  t  k  and  o<  as  deteiulned  abovef  om 


/<=  8 


A/  s=  -  /^ 


[  By  (a6)] 


A=- 


3 


fsy  (A7)] 


Then,  by  (Al5)  and  (Al7)i  one  obtains  equations  (lIi)  on  page  7. 
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IV(c)  DETECT  MEMO  NO.  9 

Subject!  "Analysis  of  the  Effects  of  Impulse  Noise  on  Moment  Detection" 
By:  T.  T,  Chang 


INTRODUCTION 

By  far  the  major  portion  of  the  literature  dealing  with  the  effects 
of  impulse  noise  on  communications  systems  is  concerned  with  seme  form  of 
statistical  estimation  based  on  experimental  data  which  is  often  very  volumi¬ 
nous.  Tlie  reasons  for  this  state  of  affairs  are  undoubtedly  the  analytic  dif¬ 
ficulties  which  are  encountered  when  one  attempts  to  analyze  what  the  effects 
of  impulse  noise  on  a  particular  communications  system  are  going  to  be.  This 
memo  presents  the  results  of  an  attempt  to  predict  how  the  performance  of  a 
moment  detection  system  would  be  affected  by  impulse  noise.  In  order  to  carry 
the  analysis  tlrough,  it  was  necessary  to  make  several  restrictive  assumptions 
regarding  the  nature  of  the  Impulse  noise  as  well  as  of  the  decision  technique. 


1. 


GENERAL  DISCUSSION 


It  is  assumed  that  the  impulses  are  true  delta  functions  whiich  are 
spread  due  to  the  finite  bandwidth  of  the  transmission  system,  so  that  the 
interfering  pulses  at  the  receiver  all  have  the  shape  h(t)  of  the  impulse 
response  of  the  transmission  system. If  the  over-all  frequency  response  of 
the  transmission  system  can  be  adequately  characterized  by  the  low-pass 
function  — _  then  the  unit  impulse  response  is  given  by 


(tJ  -t  J 
0  ^ 


It  is  known  that  the  observed  shape  of  interfering  pulses  received  over 
the  telephone  circuits  is  highly  variable,  depending  on  the  distance  be- 
twGcr.  the  receiver  and  the  location  at  which  the  interference  originatoo. 


1 


h<.t)  = 

=  O 

where  t  ■  0  designates  the  "time  of  arriTal"  of  the  pulse  at  the  receiver. 

(  RJr  convenience  we  will  henceforth  speak  of  t  ■  C  as  the  occurrence  of  the 
impulee., ) 

The  temporal  moments  due  to  a  unit  impulse  is  obtained  by  integra¬ 
tion  of  the  impulse  response  weighted  by  the  appropriate  time  function  over 
the  duration  T  of  a  word.  The  value  of  the  moment  thus  obtained  will  depend 
on  the  time  of  occurrence  of  the  unit  impulse  relative  to  the  start  of  the 
word,  this  time  increment  will  be  treated  as  a  stochastic  variable  in  the 
sequel.  Two  distinct  cases  may  be  distinguished  depending  on  idiether  the 
'.init  impulse  which  affects  a  word  occurs  after  or  before  the  beginning  of 
the  word . 

(It  is  clear  that  any  one  impulse  can  occur  only  during  one  word  but 
may  be  the  last  Impulse  to  occur  prior  to  several  words.  Thus,  the  probability 
of  error  of  adjacent  words  will  not  be  independent.  This  dependence  of  error 
probabilities  will,  however,  not  be  treated  analytically.  ) 

Case  r  will  designate  that  the  impulse  occurs  after  the  beginning  of 
the  word  (obviously  since  h(t)  -  0  for  t  <  0  the  iD^nulse  must  occur  before 
the  end  of  the  word  if  It  is  to  affect  the  moments  of  that  word) .  Let  y 
designate  the  time  from  the  beginning  of  the  word  xtntll  the  occurrence  of  the 
impulse  and  the  corresponding  order  moment.  Then 

=  J  -t- y)^ h  (i)  (Jt  (  a  ^  y  ^  T )  (1.2) 


rt  ^o) 
fi  <0  ) 


(1.1) 


Case  B  will  designate  that  the  unit  impulse  which  affects  the  word 
occurs  prior  to  the  start  of  the  word.  In  this  case,  let  ^  be  the  time 
from  the  impulse  to  the  beginning  of  the  word  and  yn''  the  corresponding 
k  order  moment .  Then 


(t-^  h(t)  dt 


(1.3) 


-  2  - 


Substituting  h(t)  as  given  by  (1.1)  and  changing  to  the  normalized  (and  non- 
dimensional)  variables 
t 


Equations  (1.2)  and  (1.3)  take  the  fonn 


(r^$re''  C4^o) 


(1.5) 


where 


As 


Taking  A  as  a  poeitive  integer, 

74  jAh 


(1.6) 


(1.7) 


Using 


r  -ar 

^  Vr 

f'! 

(ki-r)!  ’ 

g-ar 

'  f'.'  s 

n 

r  V  * 

...  ) 

A  ( 

a''  ^  ^ 

^  Jao 

si" 

A'*-®  /  ' 

-e 


(1.8) 


_L_ 
(k-r)i  of  r 


(k-r-)!  olT 


t'ss.O 


^  With  the  understanding  that  r^=/  when  f  —  S  ^  O  ,  one  may  use 


ii-  '  S  J  a  -S' 

5=0 
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/A  r-  k  ■ 

Interchanging  the  order  of  sumnation  [  ^  2  substituting 

'  fmo  S^o  SbO  t~mS 

r'  ioT  (.k.  —  t')  (and  then  dropping  the  prljnes)  yields 

nr_ 


rn 


t 

■k  ft'  - 


f!  a*-'“ 


r-mo 


(1.9) 


«;«;=  fV*f i 


n 


(1.10) 


Define 


// 

'kr^K 

and  m'i 

ki^n 

as  follows: 

7*t, 

Ann 

Mi 

II 

-f  j 

(1.11) 

‘yftf. 

im/ 

(1.12) 

(where  the  Xic-  may  be  identified  with  the  spacing  between  Inpulses.  See 
Fig\ire  1.)  Then  the  k.tk  order  monent  due  to  all  the  impulses  (1^^  1^,  l^, 
and  Ij^)  which  affect  the  word  concerned  Is  equal  to 


«■/  ( 

for  Case  A 

(1.13) 

and 

n«/ 

for  Case  B 

(l.lii) 

The  two  cases,  A  and  B,  are  illustrated  schematically  in  Figure  1. 

They  are 

differentiated  by  the  time  of  occurrence,  with  respect  to  the  word,  of  the 
last  impulse  (indicated  by  which  affects  the  word.  The  total  range  of 


-  h  - 


this  "time  of  occurrence"  when  normalized  (by  dividing  by  the  word  duration  T) 
is  equal  to  \  ,  the  nondiraensional  spacing  from  to  the  next  impulse. 

Since  does  not  affect  the  word  when  ^  ^  f  >  range  of  ^  (Case  A)  Is 

/  .  This  leaves  (Case  B).  Also  shown  in  the  slcetohes  on 

page  5  are  the  typical  graphs  of  and  as  functions  of  ^  and  ^  , 
respectively. 

Let  ^  be  the  largest  amount  by  which  the  kth  order  moment 

may  be  increased  or  decreased  respeotivaly  without  oausing  an  error  in  de¬ 
cision.  In  generali  **  and  ****  functions  of  the  particular 

word  which  is  transmitted.  We  further  assums  that  the  decision  logic  is  such 
that  an  error  will  occur  whenever  the  received  moiasnt  differs  from  the  inter¬ 
ference-free  moment  by  more  than  or  (this  assumption  is  justified 
whenever  decisions  are  based  on  only  these  two  thresholds).  There  will  be  no 
error  If 


for  Case  A 


(1.15) 


for  Case  B 


(1.16) 


In  aceoi*danoe  with  Ref.  (1)  it  is  assumed  that  the  impulse  intensity 
I  (I  may  be  I^,  I^,  l2«  or  I||)  has  a  symmetric  hyperbolic  distribution 
such  that  its  probability  density  is  given  Ity 


f(I)- 


K- / 
1 


C 


dni-c)^ 


(1.17) 


where  K  and  C  are  positive  constants. 

Prom  (1.17)  the  probability  that  I  bo  in  the  range  < X <1* 

^  /o(r)di 


(1.18) 
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Even  for  the  cas  j  where  is  a  constant,  an  analysis  based 

on  (1.15)  to  (1.18)  leading  to  an  expression  for  the  probability  of  error 
for  any  kth  order  moment  is  found  to  be  mathematically  very  cumbersome. 

For  this  reason,  further  work  will  be  restricted  to  the  cases  of  zeroth  and 
first  order  moments.  (It  also  appears  unlikely  that  if  decisions  are  based 
on  only  one  monent,  a  high  order  moment  would  be  chosen  for  this  pvu?po8e.) 


2.  ZEROTH  ORDKE  MQMEWT 

For  •sss  C  t  Equations  (1.9)  to  (1.12)  yield  : 


(2.1) 

(2.2) 

(2.3) 

(2.U) 

Then,  by  (1.15)  and  (1.16),  there  will  be  no  error 

if 

-M,'  <  J,  //- 

for  Case  A 

(2.5), 

for  Case  B 

(2.5)b 

where 

A  =  (2.6) 

n»/ 
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Note  that  ^  is  the  contribution  to  the  aeroth  order  moment  due  to 
Ig ,  . . . . ,  and  Iji  when  »  »  ^  =0. 


Let 

J-*  _  ^ 

^  i-^er^  s 

Then#  by  (2#S)»  there  will  be  no  error  if 


(2.7) 


for  Case  A 


(2.8), 


for  Case  B 


(2.8), 


PCcIAj  Xq)  ^  conditional  probability  of  being  correct  for  given 
values  of  A  axid  .  If  the  interference  is  independent  of  the  in¬ 
formation  being  transmitted,  we  may  assume  that  the  beginning  of  the  word  is 
uniformly  distributed  with  respeict  to  the  last  Interfering  pulse  I  ,  Bie 
probability  of  event  A  la  then  ° 

and  the  probability  of  event  B  is 

j  and  the  probability  densities  of  ^  and  ^  are 

and 


Afl 


p(e) 


A«-/ 


t 


-  8  - 


So  that 


PCcUjXg  )=  P(A)P(CIA)  -h  PCB)P(cfB) 


f' P(clri)fCri)clr^  ^  f 


O  '0 


Equation  (1.18)  may  now  be  substituted  Into  (2.9)  to  yield 


P(clA,\)=-^J ^ jJ*_^‘^nj['~(lM*.PeA%c.ce-^<>-f>)  ''P? 


J.  lu-^Ae^’ll  '/**- 


c~eg' 


.a.o~7) 


^rh 


r  /  C-ce~^ _ f'^le/e 


(2.10) 
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Evaluation  of  Integrals  of  the  type  appearing  In  Equation  (2.10)  is 
readily  performed  by  numerical,  graphical,  or  machine  methods,  but  is  tedious 
tn  perform  in  closed  fcxt'm.  Nsvertiieless,  it  can  be  done,  and  the  method  is 
outlined  in  the  Appendix. 

Examination  of  (2.10)  shows to  be  a  function  of  •§‘> 

Once  P(cl AjX^)  is  known,  the  probability  of  no  error  P(c)  can  (in  princi¬ 
pal)  be  found  from 

P(C)  *  j j P(c  \  (2.11) 

where  is  the  joint  probability  density  of  ^  A<j  .  Because 

of  the  lack  of  data  on  which  to  base  realistic  assumptions,  this  finatl  step 
has  not  been  undertaken  except  for  the  limiting  case  of  u^boo. 

In  order  to  he  able  to  carry  through  the  analysis  of  an  illustrative 
example,  we  assume  that  the  strength  of  each  impulse  and  the  spacing  from  ^e 
preceding  impulse  occur  independently  of  the  strngth  and  spacing  of  all  other 
impulses,  with  f>(I)  as  given  by  (1.17)  and 

fs(X)*^  ,  A, <  A  <  A^ 

“  0  ,  elsewhere 

A  and  A^  are  then  Independent  so  that 

r  (2.13) 

0  for  elsewhere  / 


) 


(2.12) 


and,  hence,  (2.11)  beconas 


(2.11;) 
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To  get  a  feeling  for  f>  (A)  ,  we  consider  the  sirapleat  case 
where  N  ■  1  (i.e.,  there  is  only  one  impulse,  preceding  I^).  For 
this  case,  (2.6)  becomes 


“A  ^  r 


A^a^er^)l^e 


(2.15) 


Prom  (2.15) t 


T  =-2 - A 


A  A, 


/-fi 


-A 


9  A, 


d/\ 


AA 


•  .1 


s  /  9A,  / 
94  / 


-z;  _ 


5  "  ^-A  < 


A(x-Xs)lAi  /-e 


4  ^ 


O  ^  elsewhere 


(2.16) 


ind 


(2.17) 
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1,  since  and  are  assumed  to  be  independent,  we  may  write  either 


oo 

p(^)=  j  fi(^,IT,)p(Z,)dT, 

^oe 


(2.18) 


oo 

;OC<JJ=y 


(2.15) 


Both  (2.18)  and  (2.19),  upon  using  (2.12),  (2.16),  (2.17)  end 

yield  •  0,1,  • 


(2.20) 


where 


l  -  y-  /-a~* 

■  / 

With  p(X,)  as  given  by  (1.1?),  (2«20)  yields 


(2.21) 


i(L(  }\  1^1-^  Sc 


r-fy&ri 


(2.22) 


Note  that 


Figure  2  is  a  plot  of  Cp(^)  vs.  lAf/c  as  given  by  (2.22)  for  K  «  3,  a  ■  1, 
Aj  -  2  and  =  3. 

For  K  -  3,  (2.22)  yields 

P  (0<A<A)^  J  f)(A)  o/A. 

o 
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I^l/c 


For  K  ij,  (2.22)  yields 


p(0<  z/f 2*%)' 


For  K  ■  3i 

P{o<A<Z)  ^  .  /  (jf  Z-fSc 

P(o<^k<oc)  '  £  ^Lc 

-/!-££ _ k^)l 

\Z-i‘Sc  X-^U/J 

and  this  ratio  is  larger  for  K  >  3*  For  a  ■  1,  ^  \  ■ 

(2.23)  gives 


P(o<a<L) 
P(0<A<oo)  " 


.95k  for 


.20 


For  the  case  where  N  ••  2,  one  my  write  (2.6)  as 

which  is  similar  to  the  Equation  (2, 15)  for  A  for  the  case  N  •»  1. 


T,  -hQ, 


^  comparing  Q  with  the  A  given  by  (2.35)  one  can  see  that 

'  99  '  ® 


or 


29.(A^-Xg)l<sii  I ilQUce'‘^^ 


ce' 


-r- 


ce 


-iuAj 


iQf  ^ 


(2.23) 

3, 

t 

Where: 

') 

I 


-  11*  - 


Then,  since  and  Q  are  Independent  according  to  our  assumptions, 

J  f>CQ)p(I=§  da 


Using  Cl.17), 


_ i_ 

(ti-QI 


crl\  iQi-hce 


^  -h  / 


IQl 


/ 

/^/ 


«/<5? 


or 


ii^zJlsUlLl  r  ^ 


sX-t 


.00 


ce" 


(Q^tdWhhcrl  y  a '^ce 


y 


(2.2U) 
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Substituting  this  expression  for  ^(f)  into  (2.20)  finally  yields  for 
the  present  case 


Ihe  above  method  can  be  extended  to  higher  N  without  diffleultyj  but 
the  computations  beeoine  more  and  more  elaborate  as  N  Increases.  If 
as  oomputed  using  Bquatlon  (2.25)  which  Is  based  on  M  ■  2  differs  only 
slightly  from  ao  computed  using  Equation  (2.20)  which  is  based  on 

N  -  1,  one  intuitively  feels  that  the  for  N  -  2  is  a  reasonable  ap¬ 

proximation  for  that  which  would  be  obtained  using  larger  raluas  of  H. 

3.  FIRST  ORDER  MOMEMf 

For  k  -  1,  Equations  (1.9)  to  (1.12)  yleldi* 


.  -r  f  ) 

(3.1) 

(3.2) 

i 

(3.3) 

(3.U) 

*Note  that  m.'  is  not  maximum  at  ^  0.  In  fact,  it  is  maxisium  at  , 

where  f  «  ^  log  (1  +  a).  Substituting  (  f  ^  ^  ^  ^  )  fat  ^  (3.1) 
becomes 

BO  that  ITZff  is  obviously  maximum  when  ^*0. 
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TUori,  by  (1.15)  and  (1.16),  there  will  be  no  error  if 


^0^  Case  A  (5.5)j| 


•M“<  for  case  B  (3.5)g 


where 


(3.6) 


Note  that  the  relation  between  6  given  by  (3.6)  and  given  by  (2*6)  is 

^ — )Aa 
dt  (  e*-/  / 

and  that  $  Is  the  contribution  to  the  first  order  moment  due  to  l^,...., 
and  Ijj  when  ^  •  ?  -0.  let 

(3.7) 

y  ^  ^  6  T"  — _ S:.  ^  ^  j 


Then,  Equation  (2.5)  applies  to  the  present  case  with  and  as  given  J)y 

(3.7)  and  plots  of  P(elA^\)  va.  for  various  desired  A,  ,  K  and 

Clin  be  obtained  by  numerical  or  graphical  integrations. 

To  obtain  closed-form  esgsressions  of  this  probability  for  thy  present 
case  is  more  involved  than  for  the  previous  case,  and  has  not  been  attempted. 
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1.  LIMITING  CASE  OF 

Far  the  lijnitiiig  caae  where  ,  we  have  /^mO  and  there  will 

be  no  error  for  Case  B«  There  will  also  be  no  error  for  Case  k  if  the  noment 

due  to  I  lies  between  -M.”  and  M,  or 

0  A  *  , 


m: 


/  -  ±  \ 


Con8equentl7i  ve  have 


T 


or^  by  using  (ltl8)| 


P(C,C,K )-  /. 


where 


m/ 


M 


JIA...  as  'h, 

C  cT^ 


Let 

Then  we  may  write 


(U.l) 


a. 2) 


where 


For  A  >  0  atxl  K  an  lnteg«r  >  2*  the  values  of  ^  ^  ^  n*iF 

eompjtted  by  using  the  relation*  '' 


This  yields: 


.-L  / 


\±L 


(li.6) 


In  using  the  relation,  one  oust  use 


^  V-// 

k-t-i 

2  k  k 


m  /  /  /  .  Sk^/  / 

-Sk  l(\  Try  2k 

.  ak-tt  zk-hi  /  ) 

~tk  k 


f  3k  ^  f 
3k  2k 


2k*t  /'  7* 

^  4  4 


Using 


and 

/  o^f  =  /  - 

one  obtains 


3(B,^tf  B^ 


(li.7) 


(U.8) 


'N 

►  (U.9) 

J 
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and 


^  /5*  /y  / 

‘  *  IfT^JJW- T-f^^  V^ 

r  -  .  j  8Jt7^*MB,*iV  _  3S  K.^-'  /  J 

^i.s  '*  4f(8,*/^  '£  17S[ 


(U.io) 


The  probability  of  no  error  for  tba  present  ease  is 

P(C)^J  PCc/o, 

or,  by  (U.l), 

A 

PCO^J  (i.^x,^if)fi(K)clK  (U.11) 

where  A^  and  A^  are  the  possible  smallest  and  largest  valuss  of  A^  . 
(Since  we  asaunsd  that  the  spaci^  between  Impulses  is  greater  than  the  word 
duration,  >  1 . )  If  ve  assume 

L  w 


•  0  for  elsovhere 


then  (U.ll)  yields 


P(C) 


1 


-  21 


To  illustrate  the  application  of  the  above  results,  we  consider  the 
on-off  binary  case  where 


1 

1 

8 

iv  ^  ■■ 

<> 

%  - 

k-h) 

for  one  symbol 


and  M  and  M  are  Interchanged  for  the  other  symbol.  Since  /c  "  ^ 

B*  •  oo  ,  -  0  for  -  eo,  and  * 

we  have  for  the  present  *  '' 

^k,K  ~  “  ^k,K 

in  which  the  values  of  to  be  used  for  computing  ^  are,  by-  ■ 

as  follows: 

4--^  4-/4 


Then  by  using  (U*5)«  (h*9)  and  (I4.IO)  one  obtains! 


(U.12) 


/i*- 


f-h 


(B^ 


BY> 


■> 

'  (U.13) 

> 


and 


-  22  - 


1 

V- 

S,  (-7^  ,e  -  1 

Vr4 

f 

^  (U.lit) 

V- 

where 

The  Table  shown  herevinder  compares  the  values  of  as  given  bjr  (U<12)> 

(U>13)>  or  (U«lU)  for  six  different  combinations  of  k  and  K  at  various  B  • 

0 

This  table  shows  higher  order  moment  detection  superior  to  zeroth  order  moment 
detection  onlv  when 

If  ^  /r-3 


ViLUBS  OP  ^ 

_  ■■  Kv3 _ 

1 _  K  ■  li 

11^ 

BB 

BB 

/<t  -  0 

^  ■  1 

■m 

0 

1 

1 

1 ' 

1 

1 

1 

1/2 

•UUUi 

.3953 

.3U69 

.2963 

.2729 

.2U99 

1 

-'’500 

.23U7 

.2181 

.1250 

.1299 

.1320 

2 

.;.iii 

.1137 

.llltS 

.0370U 

.0l;556 

.05318 

u 

.nuOOO 

.0Ul»8l 

.OU951 

.008000 

.01165 

.01597 

20 

J2268 

.002887 

.000108 

.000199 

1  100 

-000980 

. 00012 9U 

.00000097 

.00000190 
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APFENDIZ 


Method  of  &ral^latlon  of  P  (d  ^o)  • 


In  this  Appendix  a  nethod  of  evalnating  P  ( iii  closed 
form  will  be  indicated. 


Let 


Htt: 


fh 


Then  (2.10)  becorass 

and  it  is  required  to  express  PCM^ ,  A ),  *8  given  by  (Al),  in  closed  fora.* 

Due  to  the  presence  of  — Zi/  in  the 
integrals  appearing  in  (Al),  P(A//^^  )  takes  a  different  form  for  each  of 
the  following  four  ranges  of  A  •. 


For  the  first  range j 


*  Note  that  F(  od,  d  )  -  F(  o«  dv  )  ■  A^. 
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I  =  0  < 5  <  A^- 

Fcr  the  second  range i 

For  the  third  range < 

/w.’W *'*-/!/-  A  -hV^  /m.  o  <  ^ 

For  the  fotirth  range  i 

lhi*-Ae"''^I^Ae^’^-M*  /W.  ogi^gi 

//iV''-/i/-/i-H’‘e**  /«.  og?g\-i 


To  illustrate  the  procedure  in  further  detail,  we  will  only  consider  the 
second  range.  Fc«  this  range,  ^  ^  »  we  have 


'e 

t 


n-i^- 


c  -ce 


rh 


or 


X,-2  * 


CL 


-/ 


{-rTTTT 


c-^-M^-CceT^ 


j(-i 


'A«“/ 


(t^- 


,r'f _ ^ 

L  ( c-ce"*'-, 


c  -ce“* 


vA*-/ 

■)  <^7 


(A3) 


O  .  - 

The  Integrals  appearing  in  (A3),  and  in  similar  expressions  for  other 
ranges,  can  be  Integrated  by  change  of  variable  (namely,  and 

elx.  •»  ttf.  )  if  K  is  an  integer.  Thus,  for  K  -  3  or  U  one  obtains, 
reap«ctlTal7, 


t 


o(t  ^  et^  ot  £  / 


fi  /  fH  -hfiB 


(Ali) 
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or 


IC 


A  -hBe 


a.x  v-S 


>A  JC 


oi-h^e 


/S  / 


tLX 


2a,  {o(  A  J 


ci‘ 


i 


By  using  (lit)  and  c' (13)  yields 

~  c^Ae*‘) 


C-A// 


_ ^ 


C  '•AS^ 

c'  (  c‘ _ 


\,-o) 


*('^^)  /i,**Cc'-,i)e'‘^'^.-'f J 

a  sS  «/n,cC  K—  3. 


•A 

AC* 


{kS) 
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IV  (d)  DETECT  MEMO  NO.  lU 

Subject:  "Experinental  Investigation  of  Moment  Detection" 

By:  Nod  B.  Smith 

ABSTRACT 

Moment  deteotion  ie  a  technique  which  may  be  used  to  "detect" 
Information  expressed  in  pulse  code  form.  An  obvious  application  is 
the  decoding  of  pulse  code  groups  used  in  binary  data  transmission. 

This  memo  describes  the  experimental  evaluation  of  moment  deteotion  as 
used  with  a  binary  data  transmission  eystem.  Only  a  limited  amount  of 
data  was  obtained  since  early  tests  Indioated  that  moment  detection^  to 
be  used  successfully,  would  require  such  complicated  equipment  as  to 
make  this  technique  totally  unsuitable  for  use  in  a  practical  communi¬ 
cations  system , 
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I,  INIRODUCTION 


In  digital  data  transmiasion  one  is  Interested  in  the  detection  of 
information  expressed  in  pulse  code  form*  Moment  detection  can  be  used  to 
determine  the  absence  or  presence  and  the  position  of  a  pulse  or  series  of 

puls  0-5, 

As  indicated  in  Plef.  3,  a  simple  pulse  code  group  of  5  pulses  occu¬ 
pying  T  seconds  may  be  uniquely  specified  by  the  first  three  temporal  moments 
which  are  defined  as  follcwst 


«  T 

'ir(t)  dt 


M.=  t'ir(t)  dt 


M,  -  /  t  'v(t)  dt 


Table  I  gives  the  first  3  moments  for  each  of  the  32  possible  code 
groups  which  can  be  formed  from  a  5-digit  binary  code  utilizing  5  equal- 
width,  constant  amplitude  spaces  which  may  c. '  may  not  be  filled  with  rect¬ 
angular  pulses.  Referring  to  this  table,  it  will  be  noted  that  only  the 
second-order  moment  la  needed  to  specify  any  code  group.  Further,  except 
in  six  instances,  the  combinations  of  zero  and  first-order  moments  are  suf¬ 
ficient  to  specify  any  of  the  code  groups.  The  theoretically  best  manner 
of  utilizing  these  redundant  data  is  discussed  in  Appendices  I7a  and  b. 

Conceptually,  the  temporal  moments  may  be  most  easily  computed  by 
multiplying  the  given  function  and  the  required  power  of  time  and  integra¬ 
ting  the  product.  Unfortunately,  most  of  the  known  schemes  of  "electronic 
multiplication"  are  rather  complex  as  well  as  frequency-limited  and,  after 
a  brief  investigation  of  this  method  of  obtaining  the  temporal  moments,  It 
was  discarded  in  favor  of  the  iterated  integration  method  described  in 
Rex.  1. 
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The  zero- order  moment,  which  is  simply  the  area  under  the  waveform, 
requires  only  one  integrator,  thus 


Mo  = 


'ir(t)  'dt 


The  first  and  second  temporal  momenta  may  be  calculated  from  defi¬ 
nite  integrals  by  integration  by  parts. 


M, 


It  should  be  noted  that  moment  computation  by  thia  method  Is  not 
without  attendant  difficulties  since  it  may  require  the  subtraction  of 
very  large  values  to  obtain  a  comnaratively  small  answer. 


For  example,  consider  the  iterated  integration  method  in  obtaining 
the  second  moment  of  the  word  5. 


If  T  -  5  and  the  amplitude  of  v(t)  is  1,  then  the  waveform  corres¬ 
ponding  to  this  word  is 


(t) 


I,  0  <  t  <  I 
I,  2  i  t  <  3 
0,  elsewhere 


-  h  - 


and  the  second  moment  is  found  from 


where 


Msivs)  “  25  H 
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h(t) 


't,  Q.^t<i 

i  ,  i  6  t  <  2 

1  t  (t‘2) ,  2  ^  t  <3 

2  ,  3  ^  t  <  5 
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the  second  moment  Is  found  from 


25  -  h5  +  y 


1 

3 


The  primary  purpose  of  this  investigation  was  to  determine  the 
error  probability  attainable  with  moment  detection  used  with  a  practical 
remote  binary  data  transmission  system  using  conventional  telephone  line 
transmission  bandwidths.  Probability  of  error  was  determined  as  system 
parameters  were  varied,  including  received  signal-to -thermal  noise,  signal- 
to-.impulse  noise,  transmission  line  bandwidth,  and  signaling  speeds.  Since 
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it.  was  obviously  impractical  to  test  all  combinations  of  pulse  code  groups 
and  system  parameters  because  of  the  tremendous  amount  of  data  reduction 
which  would  be  required,  only  a  set  of  representative  words  and  varLable 
system  parameters  were  used.  'Rie  scope  of  these  tasts  was  thus  1  united  to 
what  seemed  practical  from  a  data  reduction  standpoint  and  still  yield  suf¬ 
ficient  test  data  for  an  evaluation  of  the  expected  system  performance  using 
moment  detection. 

II.  EXIERIMENrAL  APPROACH 

The  experimental  approach  taken  in  the  evaluation  of  the  performance 
of  moment  detection  was  as  follows s 

1.  Record  thermal  noise  and  impulse  noise  on  magnetic  tape. 

2.  Generate  coded  signals  with  noise  added  from  the  magnetic  tape. 

3.  Transmit  the  composite  signal  (noise  plus  signal)  by  FSK  over  a 
simulated  telephone  line, 

ii.  Compute  the  three  moments  of  each  word,  using  the  unfilterad  de¬ 
tected  output  of  the  FSK  Receiver  as  the  input  to  the  moment  com- 

.  il- 

puter. 

5.  Record  the  moments  on  a  magnetic  tape  and  slow  down  the  magnetic 
tape  32 rl  because  of  the  limitations  of  the  digitizing  equipment 
used. 

6.  Digitize  the  analog  moment  outputs  of  the  slowed-dcwn  magnetic  tape 
by  an  analog-to-digital  converter  and  record  on  digital  paper  tape. 

7.  Transfer  the  d.  •  'tized  moment  data  on  the  paper  tape  to  IBM  cards 
in  the  70U  computer  fomat. 

8.  Compute  the  er  .  probability  on  the  IBM  70h  computer. 


The  unfiltered  outj  was  used  because  moment  detection  inherently  per¬ 
forms  a  lovj-pass  fi  ■'ing  action  and  it  was  desired  to  avoid  phase 
shifts  due  to  an  adc  na"'  low-pass  filter.  However,  it  was  noted  that 
use  of  the  filtered  iji..  .uad  of  the  unfi’ tered  output  did  not  result  in 
an  obsei’'/ablo  change  in  the  performance  of  the  moment  computer. 
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III.  EQUlFMEWr  DESCRIFTION 


A.  General 

Figure  1  is  a  detailed  block  dia grain  of  the  digital  data  transmis¬ 
sion  system  iind  evaluator  asseinbled  to  investigate  moment  detection  experi¬ 
mentally.  Figures  2  and  3  are  photographs  of  the  experimental  equipment 
which  was  used. 

The  equipment  consisted  of  a  thermal  noise  generator,  an  impulse 
noise  generator,  and  a  clock  generator  vnose  outputs  were  recorded  on  three 
channels  of  an  Ampex  tape  recorder.  A  series  of  master  t-apes  were  made, 
using  these  three  inputs,  in  order  that  repetitive  tests  could  be  made  under 
almost  identical  conditions  of  words,  thermal  noise  and  impulse  noise.  The 
clock  generator,  imp'ilse  noise  generator  and  thermal  noiae  generator  ware 
used  only  to  make  the  master  tapes,  “nie  recorded  clock  pulses  were  fed  to 
the  encoder  which  consists  of  a  word  and  synchronizing  generator  capable  of 
repetitively  generating  any  selected  one  of  the  32  possible  words  of  a  5-bit 
binary  cicde.  The  output  of  the  word  generator  was  fed  to  an  FSK  modulator 
(Model  3000  Tele  -Signal)  which  was  used  to  convert  the  binary  input  data  to 
frequency  shift -keyed  signals  suitable  for  remoue  data  transmission.  The 
output  of  the  FSK  modulator  was  then  fed  to  a  simulated  telephone  line  which 
consisted  of  variable  filters.  The  impulse  noise  and  thermal  noise  channels 
of  the  master  tape  were  also  used  as  inputs  to  the  simulated  telephone  line. 
The  composite  signal  output  of  the  telephone  line  (FSK  signals  plus  thermal 
and  Ir.pulse  noise)  was  then  fed  to  the  FSK  demodulator  (Model  3000  Tele-Sig¬ 
nal).  The  unfiltered  discriminator  output  of  the  FSK  demodulator  (receiver) 
was  then  fed  to  the  input  of  the  moment  computer.*  Synchronizing  signals  re¬ 
quired  by  the  moment  cornp.itcr  were  obtained  directly  from  the  synclironizing 
generat-or.  The  three  moment  outputs  of  the  computer,  together  with  the  syn¬ 
chronizing  signals,  were  then  recorded  on  an  Ampex  FR-100  FM  tape  recorder. 
The  recorded  moments  viere  next  digitized  by  means  of  an  Epsco  analop-to- 
digital  converter,  the  output  of  which  v/as  recorded  on  paper  tape  by  means 


See  Fo^itncte, 


page  6. 
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SIMUUTED  TELEPHONE  LINE 
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FIGURE  I  BLOCK  DIAGRAM,  F.S.K.  AND  MO»KNT  DETECTION  EVALUATOR 


FIGURE  2  EXPERIMENTAL  EQUIPMENT  USED  DURING  EVALUATION 


€ 


1.1. 


FIGURE  3  EXPERIMEmAL  EqUIPMEITT  USED  DURING  EVALUATION 


of  a  Tally  punch.  Since  the  Tally  digital  paper  tape  punch  was  incapable  of 
operating  in  real  time,  the  tape  containing  the  three  recorded  moments  was 
"slowed  down"  32:1.  The  digital  paper  tape  was  then  used  to  prepare  the  IBM 
cards  that  were  used  to  introduce  the  data  into  the  IBM  70li  computer  where 
the  error  probability  was  computed. 

Since  a  comparison  of  FSK  performance  with  that  of  moment  detection 
was  desired,  the  filtered  output  of  the  FSK  discriminator  was  fed  in  the 
normal  fashion  to  the  transistor  switch,  which  is  a  part  of  the  FSK  receiver. 
The  output  of  the  FSK  transistor  switch,  together  with  the  output  of  the  word 
generator,  were  then  used  as  inputs  to  an  error  comparator  and  the  number  of 
bit  errors  were  recorded  on  a  Hewlett-Packard  522B  counter.  The  number  of 
words  sent  during  each  run  was  recorded  by  another  H-P  522B  counter.  The 
probability  of  bit  error  for  each  run  was  then  computed  as  one-fifth  of  the 
ratio  of  these  counts. 

B.  Detailed  Description  of  the  Bquignent 

1.  Thermal  Noise  Generator 

A  General  Radio  1390B  Random  Noise  Generator  was  used  as  a  source  of 
thermal  noise.  This  uses  a  gas  tube  as  a  noise  sotirce  and  has  an  "essentially 
Gaussian"*  output  when  used  in  the  20  kc/s  bandwidth  position. 

Figure  ii  is  a  photograph  of  the  waveform  at  the  output  of  the  telephone 
filter  when  it  is  driven  by  the  thermal  noise  generator)  Figure  5  of  the  output 
of  the  FSK  transmitter  with  a  steady  space  input,  and  Figure  6  oi  'he  combined 
thermal  noise  and  FSK  signal  at  the  output  of  the  simulated  telephone  line, 

2.  Impulse  Generator 

Figure  7  is  a  block  diagram  of  the  impulse  noise  generator  used.  The 
design  of  the  impulse  generator  was  based,  in  part,  on  the  data  presented  by 
Mertz  in  Reference  2. 

The  impulse  generator  consists  of  a  pulse  generator  controlled  by  a 


See  General  Radio  Catalog  for  qualification  of  "essentially  Gaussian." 
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FIGURF.  4 

OUTPUT  OF  FILTER  DRIVEN 
WITH  THERMAL  NOISE 


FIGURE  5 

OUTPUT  FSK  TRANSMITTER, 
STEADY  SPACE  INPUT 


FIGURE  6 

COMBINED  THERMAL  NOISE 
AND  FSK  SIGNAL  AT  TELEPHONE 
LINE  OUTPUT 
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FIGURE  8 


FSK  SIGNAL  (STEADY  SPACE  INPUT) 
AT  TELEPHONE  LINE  OUTPUT 


B  FIGURE  9 

IMPULSE  BURST  AT 
TELEPHONE  LINE  OUTPUT 


FIGURE  10 

COMBINED  FSK  SIGNAL  AND 
IMPULSE  BURST  AT  TELEPHONE 
LINE  OUTPUT 
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random  noise  source.  The  output  pulses  were  shaped  and  then  fed  to  a  gate. 

The  gate  duration  was  varied  randomly  by  another  controlling  noise  source . 

Provision  was  made  in  the  design  of  the  impulse  generator  to  vary 
the  frequency  and  duration  of  the  bursts  by  adjusting  the  output  of  the  con¬ 
trolling  noise  generators.  Figure  8  is  a  photograph  of  the  signal  output 
from  the  telephone  line  filter  with  a  steady  space.  Figure  9  shows  a  burst 
from  the  impulse  generatori  and  Figvire  10  shows  the  combined  signal  and  im¬ 
pulse  burst  at  the  output  of  the  filter.  It  should  be  noted  that  Figure  10 
is  a  photograph  of  the  combined  signal  and  an  impulse  burst  which  is  not  the 
same  Impulse  burst  pictured  in  Figure  9. 

3.  Clock 

A  Hewlett-Packard  Model  212A  pulse  generator  was  used  as  a  source  of 
clock  pulses.  The  clock  pulses  were  used  for  basic  timing, of  all  digital  and 
control  operations. 

li.  Master  Control  Tapes 

A  series  of  master  control  magnetic  tapes  were  prepared  using  the 
outputs  of  the  clock,  thermal  noise  generator  and  impulse  noise  generator 
as  inputs  to  three  of  the  tracks. 

These  tapes  were  then  used  as  sources  of  clock  pulses,  thermal  noise 
and  impulse  noise  for  all  of  the  test  runs  made  in  evaluating  moment  detection 
and  FSK  performance.  These  master  control  tapes  were  used  to  reduce  the  pos¬ 
sibilities  oi  variations  of  input  conditions  between  runs  which  were  to  be 
made  under  similar  input  conditions.  For  instance,  this  permitted  one  to 
evaluate  the  effects  of  changing  bandvridth  while  maintaining  the  same  signals 
and  noise. 

5.  Word  and  Synchronizing  Generator 

Fif'ure  11  is  a  block  diagram  of  the  word  and  synchronizing  generator. 
The  word  generator  was  \ased  for  the  selective  generation  of  any  one  of  the  32 
words.  The  word  generator  consisted  of  an  eight-stage  serial  shift  register. 
Write  switches  were  used  to  permit  the  introduction  of  any  one  of  the  32  pos¬ 
sible  words  into  the  register. 
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WORD  CONTROL  SWITCH 
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HI  STABLE  ELEMENT 

FIGURE  II  WRD  AMD  SYNC.  GENERATOR 


The  synchronir.inj  /'cnorntor  was  used  to  control  operations  which 
occur  at  word  rate,  Tho  swclironizinc  generator  was  also  an  eight-stage 
serial  shift  register.  The  outputs  of  the  synchronizing  generator  were  used 
to  control  both  the  transmitting  and  receiving  digital  logic  equipment. 

Figures  12,  13  and  Ih  are  photographs  of  the  waveforms  of  the  words 
1,  2  and  5  respectively,  existing  at  the  output  of  the  word  generator.* 


FIGURE  13 

WORD  2  AT  OUTPUT 
OF  WORD  GENERATOR 


FIGURE  14 

WORD  0  AT  OUTPUT 
OF  WORD  GENERATOR 


6.  Modulator  and  DfiimofluJator  (Transmitter  and  Receiver) 

A  Tele-3i['nal  Corporatdon.  Model  3000,  I’SK  High  Speed  Digital  Ter¬ 
minal  set  was  used  both  as  a  mfriul.;  t,or  and  demodulator.  The  modulator  was 
Used  as  supplied  by  the  monuj'ac’.,ur(.r.  fne  unTiltered  output  of  the  fre- 
ouency  discriminator  output  o!'  th.c  receiver  was  used  as  the  signal  input  to 
the  moment  computer. 

jj. 

Refer  to  Section  III. .na!  t  i,  are  I'or  an  ex])lanation  of  the  eight 
spaces  allocated  for  '.■ac};  i.-hl'  ■..•erd  an  sliown  in  1  igures  12,  13  and  lU. 
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7.  Simulated  Telephone  Idne 

Figure  IS  is  a  block  diagram  of  the  variable  filter  used  to  simulate 
the  transmission  characteristics  of  various  commercial  telephone  lines.  The 
filter  was  divided  into  three  parts,  one  section  consisting  of  additive 
mixers  to  permit  variable  signal  degradation,  the  second  section  having  vari- 
able  attenuation  characteristics,  as  shown  in  Figure  16,  and  the  third  section 
having  variable  envelope  delay  characteristics,  as  shown  in  Figure  17.  The 
attenuation  section  consisted  of  low  and  high-pass  sections  having  variable 
cut-off  frequencies.  The  envelope  delay  section  consisted  of  all  pass  sections 
which  permitted  control  of  phase  characteristics.  The  signal  degradation  sec¬ 
tion  consisted  of  two  signal-plus-noise  mixers  of  the  conventional  resistive 
matrix  type.  Amplifiers  were  used  to  restore  the  signal  to  its  original  ampli¬ 
tude.  The  thermal  noise  and  impulse  noise  signals  obtained  from  the  master 
tapes,  together  with  the  input  signal  obtained  from  the  output  of  the  FSK 
modtilator,  were  used  as  inputs  to  the  signal -plus -noise  mixers.  Controls  per¬ 
mitted  the  adjustment  of  the  sigral-to-thermal-noise  and  signal -to-inpulse- 
noise  ratios  over  a  wide  ranges. 

8.  Demodula  tor 

The  demodulator  was  part  of  the  equipment  discussed  in  Item  6. 

Figure  18,  19  and  20  are  photographs  of  the  wavefcrms  of  the  words 
1,  2  and  5  respectively,  taken  at  the  output  of  the  fSK  receiver  (demodulator) 
discriminator  with  the  FSK  filter  connected  and  the  simulated  telephone  line 
In  its  nominal  condition.  Figures  21,  22  and  23  are  the  wavefoms  obtained 
with  the  FSK  filter  disconnected.  Figures  2U,  25  and  26  are  photographs  of 
the  waveforms  of  the  words  1,  2  and  -  with  the  FSK  filter  disconnected  and 
thermal  noise  added. 

9.  Moment  Computer 

Figure  27  is  a  block  diagj  of  the  moment  computer.  The  design  fol¬ 
lows  closely  the  technique  descrj  •'  in  Ref.  1.  The  three  moments  were  com¬ 
puted  by  means  of  the  iterated  in  '..^ration  scheme  previously  described. 

Fig\u*e  28  is  a  timing  chart  of  thi  nuts  to  the  computer.  It  will  be  noted 
that  three  blank  spaces  existed  aftti  cacii  word,  i«e.,  an  eight-bit  word  was 
actually  used  Instead  of  a  five-bit  word  and  the  last  three  bits  of  each  word 
were  always  "0".  This  was  done  to  permit  resetting  the  computer  after  each 
computation. 
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FIGURE  15  BLOCK  DIAGRAM,  SIIWLATED  TELEPHONE  LINE 
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FIGURE  17  ENVELOPE  DEUY  CHARACTERISTICS  OF  THE  SIMULATED  TELEPHONE  LINE 

(VARIABLE  FILTER) 


FIGURE  18 


DISCRIMINATOR  OUTPUT, 
WORD  I 


FIGURE  19 

DISCRIMINATOR  OUTPUT, 
WORD  2 


FIGURE  20 
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FIGURE  21 

DISCRIMINATOR  OUTPUT, 
FSK  FILTER  DISCONNECTED, 
WORD  I 


FIGURE  22 

DISCRIMINATOR  OUTPUT, 
FSK  FILTER  DISCONNECTED, 
WORD  2 


FIGURE  23 

DISCRIMINATOR  OUTPUT, 
FSK  FILTER  DISCONNECTED, 
WORD  6 


FIGURE  24 

FSK  DISCRIMINATOR  OUTPUT, 
WORD  I  PLUS  THERMAL  NOISE, 
FSK  FILTER  DISCONNECTED 


FIGURE  25 

FSK  DISCRIMINATOR  OUTPUT, 
WORD  2  PLUS  THERMAL  NOISE, 
FSK  FILTER  DISCONNECTED 


FIGURE  26 

FSK  DISCRIMINATOR  OUTPUT, 
WORD  5  PLUS  THERMAL  NOISE, 
FSK  FILTER  DISCONNECTED 
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FIGURE  27  BLOCK  DIAGRAM,  MOMENT  COMPUTER 
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FIGURE  28  TIMING  CHART,  MOMENT  DETECTION 
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1000  PPS 


126  PPS 


FifTure  29  is  a  photofiraph  taken  of  the  waveform  of  the  word  31  (base 
band)  at  the  input  to  the  computer.  Figure  30  was  taken  at  the  input  to  the 
first  integrator.  Figure  31  was  taken  at  the  output  of  the  first  integrator 

<"„  )• 

Figure  32  shows  the  input  to  the  adder;  Figure  33  shows  the  Ig 
input  to  the  adder  and  Finire  3I4  shows  the  sum  of  and  Ig  at  the  output 
of  the  adder.  This  waveform  attains  a  value  proportional  to  the  first 
moment  at  time  t  T. 

Figure  I')  shows  the  input  to  the  Mg  adder;  Figure  36  shows  the  Ig 
input  to  the  adder;  Figui'e  3?  shows  the  input  to  the  Mg  adder,  and 
Figure  38  the  sum  of  +  Ig  +  1^  at  the  output  of  the  Mg  adder.  This  wave¬ 
form  attains  a  value  proportional  to  Mg  at  tine  t  ■  T. 


FIGURE  31 

OUTPUT,  I8T  IHTEORATOR, 
WORD  31 
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FIQURE  32 


1ST  INTEQRATOR  INPUT 
TO  H,  ADDER, 

WORD  31 


FIQURE  33 

2N0  INTEORATOR  INPUT 
TO  M)  adder, 

WORD  31 


FIQURE  3^ 

SUM,  1ST  AND  2ND  INTEGRATORS 
AT  OUTPUT,  H,  ADDER, 

WORD  31 


FIGURE  35 


1ST  IHTEflRATOR  INPUT 
TO  H2  adder, 

WORD  31 


FIGURE  36 

2ND  INTEGRATOR  INPUT 
TO  M2  adder, 

WORD  31 


FIGURE  37 

3R0  INTEGRATOR  INPUT 
TO  H2  adder, 

WORD  31 


FIGURE  38 

SUM  1ST,  2ND  AND  3RD 
INTEGRATORS  AT  OUTPUT 
OF  H2  adder,  word  31 


10.  Error  Rate  E^valuatiorij  Momant  Detection 

An  Ampex  FR-100  FM  magnetic  tape  recorder  was  used  to  record  the 
three  analog  outputs  of  the  moment  computer  plus  a  synchronizing  signal  to 
indicate  correct  sampling  time.  The  analog  outputs  of  the  tape  recorder 
were  then  digitized  by  an  Epsco  analog-to-digital  converter  and  then  re¬ 
corded  on  digital-punched  paper  tape.  The  digital-punched  paper  tape  data 
were  then  transferred  to  IBM  input  format  on  punched  cards  and  finally  the 
data  were  evaliiated  by  an  IBM  70U  computer. 

11.  Error  Rate  Evaluation.  FSK  Equlment 

Ihe  filtered  output  of  the  FSK  demodulator  was  fed  to  the  FSK  tran¬ 
sistor  switch.  The  outputs  of  the  FSK  transistor  switch  and  the  output  of 
the  word  generator  were  then  used  as  inputs  to  an  error  comparator.  Word 
count  and  FSK  error  bit  covint  were  made  by  two  H-P  522B  counters. 


IV.  TEST  PROCEDURES 

A.  Selection  of  Teat  Conditions 

As  pointed  out  in  the  introduction,  it  was  necessary  to  limit  the 
number  of  combinations  of  system  pa.*ameters  used  in  order  to  reduce  the  data 
reduction  task  to  reasonable  proportions.  It  was  therefore  decided  to  sel>.'Ot 
a  set  of  nominal  parameter  values  and  to  investigate  the  sensitivity  of  the 
error  probability  to  deviations  from  these  values. 

1.  Words 

A  physical  three-dimenaional  model  (Figure  39),  representing  all  32 
possible  5-bit  words  in  the  orthonormalized  three  space  in  which  variations 
of  the  output  due  to  white  Gaussian  noise  have  a  normal  three-dimensional 
spherical  distribution  (refer  to  Appendix  IV. b),  was  constructed.  It  was  found 
that  in  this  space  there  exists  zero  point  symmetry  so  that  only  16  words  need 
bs  considered.  The  distances  between  every  word  and  all  other  words  was  tabu¬ 
lated  and  three  words,  viz.,  1,  2  and  5,  were  selected  as  being  representative 
of  the  set. 

2.  Signal-to-Thermal-Noise  Ratios  and  Signal-to-Impulse-Noise  Ratios 

These  ratios  were  selected  on  the  basis  of  blt-for-bit  FSK  error  com¬ 
parisons  with  a  criuerion  of  at  least  ten  errors  in  20  seconds  of  real  time. 
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(At  much  lower  error  rates  an  unreasonable  amount  of  time  vjould  be  required 
for  the  experiment  and  for  reduction  of  the  data.) 

3.  Signaling  Speed 

A  1000-bits/second,  125-words/second  noini..c.?  rate  was  selected  on  the 
basis  of  reasonable  F3K  (Model  3000  Tele-Si^al)  equipment  performance.  If  a 
signal  of  alternate  "O's"  and  "I's"  is  sent  at  this  rate  through  the  nominal 
telephone  line  filter,  the  output  of  the  discriminator  approximates  a  SOO-cps 
sine  wave. 

U.  Telephone  Line  Bandwidth  and  Envelope  Delay 

Reference  to  Figures  16  and  17,  and  Ref,  1,  shows  that  the  band -pass 
and  envelope  delay  characteristics  obtained  with  the  corresponding  control¬ 
ling  switches  set  at  positions  2  are  about  half-way  between  the  minimum  and 
maximum  bandvldths  and  envelope  delays  of  90‘4  of  the  telephone  lines  in  the 
United  States , 

Nominal  settings  of  the  simulated  telephone  line  as  used  in  these 
tests  were  those  obtained  with  all  controlline  switches  except  the  low  pass 
in  switch  positions  2.  Nominal  setting  of  the  low -pass  switch  was  at  position 
3  (highest  cut-off  frequency)  to  avoid  severe  amplitude  differences  between 
mark  and  space  frequencies  at  the  input  of  the  FSK  receiver. 

5.  Moment  Computer  Integration  Time, 
faischarge  Kilse  Timings  and  Gate  Positions 

Adjustments  were  made  for  b'^at  computer  performance  under  nominal  con¬ 
ditions.  These  adjxistments  were  not  changed  except  when  the  signaling  speeds 
were  altered  during  the  tests. 

6.  Synchronizing 

Since  an  evaluation  of  synchronization  was  not  of  interest  ner  nc, 

•  ’r.r’  ;i.n  oj'iier  to  avoid  aikiitional  comMlexity,  ciiaplc  cxlc.'nal  nyn-- 
chronization  was  used  to  s,ynchronize  the  moment  computer.  It  should  be  noted 
that  the  same  external  synchronization  system  was  used  with  the  FSK  error 
comparator  for  determining  FSK  bit  error  rates. 


B.  Master  Tape  Recordings 

A  series  of  master  tapes  were  made  on  an  kmpQx,  Model  S  3UU9  magnetic 
tape  recorder.  Clocic  pulses,  thermal  noise  and  impulse  noise  were  recorded, 
each  on  a  separate  channel  of  the  tape.  During  the  tests,  the  clock  generator, 
thermal  noise  generator,  and  impulse  noise  generator  were  replaced  by  the 
three  outputs  of  the  tape  recorder  to  insure  similar  inputs  to  the  equipment 
during  repetitive  runs  (e.g.,  same  thermal  noise  and  Impulse  noise  for  each 
word  1,  2  and  5)- 

C.  Initial  Tests  (base  band  only) 

In  order  to  check  performance  of  the  computer  against  mathematically 
predicted  results  at  various  signal  energy/thermal  noise  power  density  (E/N^) 
ratios,  preliminary  base  band  tests  were  made. 


V,  TEST  RESULTS 

A.  Base  Band  Tests 

Figure  UO  is  a  plot  of  the  probability  of  error  vs.  signal  energy/ 
thermal  noise  power  density. '  Only  the  zero-order  moment  was  recorded  and 
only  words  0  and  31  were  sent.  The  theoretical  curve  of  error  probability 
vs.  E/n^  is  also  shown  on  this  figure  and  is  seen  to  be  in  go6d  agreement 
with  the  ejqserimental  points. 

B.  Experimental  Error  Rrobability  of  the  F3K  Equipment 

Figure  Ul  is  a  plot  of  the  probability  of  bit  error  vs.  signal 
onergy/themial  noise  power  density  lor  the  words  1,  2  and  5.  For  purposes 
of  comparison,  the  theoretical  curve  for  a  wide  deviation  noncoherent  FSK 
system  operating  in  the  presence  of  additive  white  Gaussian  noise  is  also 
shown.  In  this  case  the  probability  of  error  is  given  ^7  Pg  ■  j 
(Ref.  U).  It  is  to  be  noted  that  this  equation  can  not  be  expected  to  de¬ 
scribe  the  performance  of  the  experimental  equipment  for  several  reasons, 
e.g.,  the  restricted  bandwidth  of  the  telephone  line  filters,  nai’row  de¬ 
viation  FSK,  use  of  a  discriminator  rather  than  two  matched  filters.  As 
will  be  discussed  later,  the  FSK  equipment  showed  a  variation  in  mark  and 
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FIGURE  W  PROBABILITY  OF  ERROR  VS  SIGNAL  ENERQY/THERMAL  NOISE 
POWER  DENSITY 
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space  output  levels,  depending  on  the  particular  word  sent.  It  is  believed 
that  the  deoendance  of  error  nrobability  on  the  transmitted  word  which  is 
annarent  in  Figure  lil,  is  related  to  this  phenomenon. 

Figure  k2  is  a  plot  of  the  probability  of  error  vs.  signal  ampli¬ 
tude/impulse  amplitude  at  the  input  to  the  simulated  telephone  line.  The 
impulses  which  vrere  used  were  essentially  rectangular  and  of  2-^/i8ec.  dura¬ 
tion.  No  errors  were  observed  when  the  signal -to-impulse  noise  amplitude 
ratio  was  -16  db .  The  curves  in  the  lower  right  region  of  Figure  li2  have 
therefore  been  extrapolated  and  are  shown  dashed. 

Table  2  shows  the  error  probability  obtained  as  the  high-pass  and 
low-pass  cut-off  characteristics  were  varied  with  a  signal  energy/thermal 
noise  pxjwer  density  ratio  of  15  db  at  the  input  to  the  telephone  line  filter. 

Table  3  was  obtained  under  the  same  conditions  as  Table  2  except 
impnilse  noise  was  fed  to  the  injsut  of  the  filter  at  a  signal-to-lmpulse 
amplitude  ratio  of  •21.1i  db.  (The  rms  signal  was  ,08  volts  and  the  peak  im¬ 
pulse  level  was  1-1/3  volts.)  Again,  the  high-pass  and  low-pass  cut-off  fre¬ 
quencies  of  the  simulated  telephone  line  were  varied. 

Table  4  was  obtained  with  the  filter  at  nominal  settings  and  a  signal 
anergy/thermal  noise  power  density  of  15  db  and  a  signal-to-lmpulse  amplitude 
ratio  of  -21. U  db  at  the  input  to  the  filter. 

Figure  U3  is  a  plot  of  error  probability  vs.  average  Impulse  spacing 
at  a  constant  -i21.U  db  signal -to-input  amplitude  ratio  at  the  input  to  the 
simulated  telephone  line . 

C.  Experimental  Error  Probability  of  the  Moment  Detector  Equlment 

Figure  UU  shows  the  measured  word  error  probability  obtained  by  means 
of  moment  detection  plotted  versus  the  ratio  of  signal  energy /thermal  noise 
power  density  (E/N^^, .  On  this  figure,  upper  and  lower  bounds  of  the  word 
error  probability  obtained  by  the  FSK  equipment  are  also  shown.  The  upper 
bound  is  obtained  on  the  assumption  that  there  occurs  only  one  bit  error  per 
word  in  error.  Since  each  word  contains  5  bits,  it  is  seen  that  the  proba¬ 
bility  of  word  error  is  then  5  times  the  measured  probability  of  bit  error. 
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i . i  TEST  CONDITIONS  . 1 

■I . +•  ■■  -j 

. i  SIQNALINQ  SPEED:  1000  BITS/SECOND  i 

■i . i—  LOW-PASS  CURVE:  3 

HI  OH-PASS  CURVE:  2 

;■  ENVELOPE  DELAY  CURVE;  2  j 


IMPULSE  NOISE,  SPACING:  10  MILLISECONDS 


SIQNAL  AMPLITUDE 
IMPULSE  AMPLITUDE’ 


(AT  FILTER  INPUT) 


FIGURE  42  F.S.K.  PROBABILITY  OF  BIT  ERROR  VS  SIQNAL  AMPLITUDE/ IMPULSE 
AMPLITUDE,  WORDS  I,  2,  5 
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TABLE  2 

FSK  SIT  'ERROil  PROSkSILITY’  AS  A  FUNCTION  OF  LINE  FILTER  KlOH  PASS  CUT  OFF  FREQUENCY  WITH 
LOW  PASS  CUT  OFF  AT  2.2  K.C.S.  (3  Kb).  SIONAL  FNEROY/THERMAL  NOISE  POWER  DENSITY  •  IS  db 


HI  OH  PASS 

CUT  OFF,  C.P.S. 
(AT  3  db) 

ERROR  i>ROBABIIITY 

WORD  1 

WORD  2 

WORD  5 

0 

0.0070 

o.ooe»5 

0.0085 

145 

0.0032 

0.Q02I7 

0.0046 

ISO 

0.055 

0.050 

O.ISO 

280 

O.OSS 

O.IOI 

0.212 

FSN  BIT  ‘ERROR  PROSASILITY’  AS  A  FUNCTION  Of  LINE  FILTER  LOW  PASS  CUT  OFF  FREQUENCY  WITH 
HION  PASS  CUT  OFF  AT  I4S  C.P.S.  (3  db).  SIONAL  ENEROY/THERHAL  NOISE  POWER  DENSITY  •  IS  db 


LOW  PASS 

CUT  OFF.  R.C.S. 
(AT  3db) 

ERROR  PROBABILITY 

WORD  1 

WORD  2 

WORD  5 

O.OOS3 

0.0047 

0.0087 

2.10 

.0032 

0.0030 

0.0052 

3.05 

.0032 

0.0025 

0.0044 

TABLE  3 

SIT  ERROR  PROSASILITY  AS  A  FUNCTION  OF  LINE  NION  PASS  CHARACTERISTICS  WITH  LOW  PASS  CUT  OFF 
AT  2.2  R.C.8.  (3  db),  SIONAL  TO  IMPULSE  NOISE  AMPLITUDE  RATIO  -  -21.4  db  (SEE  CURVES  FIS.  IS) 


HION  PASS 

CUT  OFF,  C.P.S. 
(AT  3  db) 

ERROR  PROSABILITY 

- 1 

WORD  1 

WORD  2 

WORD  5 

0 

0.044 

0.043 

0.052 

145 

0.0036 

0.0034 

0.0050 

ISO 

0.0142 

0.0158 

0.025 

280 

0.038 

0.0410 

0.112 

ERROR  PROSASILITY  AS  A  FUNCTION  OF  LINE  LOW  PASS  CHARACTERISTICS  WITH  HlOH  PASS  CUT  OFF  AT 
145  C.P.S.  (3  db).  SIONAL  TO  IMPULSE  NOISE  AMPLITUDE  RATIO  ■  -21.4  db  (SEE  CURVES  FIO.  IB) 


LOW  PASS 

CUT  OFF,  N.C.S. 
(AT  3  db) 

ERROR  probability 

WORD  1 

WORD  2 

WORD  5 

0.00*5 

0.0096 

.0149 

2.10 

0.00212 

P.0027 

.DOBS 

3. OS 

0.0056 

o.OOBO 

.0044 

TABLE  U 

ERROR  PROBABILITY  OF  WORDS,  SIONAL  ENEROY/THERMAL  NOISE  POWER  DENSITY  '  IS  db.  SIONAL  TO 
impulse  noise  amplitude  ratio  •  -21.4  db,  FILTER  AT  NOMINAL  SETTINOS  (SEE  CURVES  flO.  IS) 


WORD 

FRROR 

PRODABlLITy 

1 

0.0156 

2 

0.0224 

5 

0.0239 
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BIT  PKOBABILITY  OF  EBMR 


MORD  ERROR  PROBABILITr, 


E/Nf  IN  d.b. 

FIGURE  >44  MOMENT  DETECTION  PROBABILITY  OF  ERROR  VS  SIGNAL  ENERQY/THERMAL  NOISE 
POWER  DENSITY,  WORDS  I,  2,  5 
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The  lovjer  bo\ind  is  obtained  on  the  assumption  that  there  occur  5-bit  errors 
per  word  in  error  so  that  the  probability  of  word  error  equals  the  proba- 
ii'lit.v  oi  lit  error.  Kinure  hS  shows  the  measured  word  error  nroba- 
bil  ity  obtained  by  moment  detection  plotted  versus 

bounds  on  word  error  probability  obtained  by  the  thK  syStem  under  these  con¬ 
ditions  are  also  plotted  in  Figure  U5  for  comparison  purposes. 

Inspection  of  Figures  Uii  and  U5  shows  that  the  performance  attainable 
with  the  moment  detection  equipment  was  far  inferior  to  that  obtainable  with 
the  F3K  equipment.  Under  these  circumstances,  it  did  not  appear  warranted  to 
in'-nrtirate  moment  dotsetion  furth-sr- 

VI.,  DJ.3CUS3IQN  OF  TilST  KIi3ULr3 

A.  FSK  Equipment 

,  ■  '  y 

A  complete  set  of  runs  was  made  on  the  l''3K  equipment.  Ihe  probabili- 
ijes  of  error  obtained  vyere  reasonably  compatible  with  theory.  VIhilo  the 

■  r.'i'i'or  rates  were  somewhat  higher  than  would  be  expected  of  an  optimum  nonco¬ 
herent  FSK  system,  it  'was  felt  that  this  was  due  mainly  to  the  FSK  equipment 

■  deficiencies  noted  In'the  following  section. 

,/ 

For  purposes  'lof  comparison  with  moment  detection,  which  yields  word 
error  probability,  th';b  word  error  probability  obtained  with  FSK  would  be  de¬ 
sirable.  In  Section  V.C.,  it  vras  shown  how  upper  and  lower  bounds  on  word 

error  probabilities  may  be  obtained  from  the  measured  bit  error  probabilities. 

/ 

B .  Moment  Detection  ; 

Although  a  complete  set  of  runs  were  made  and  recorded  on  magnetic 
tape,  only  two  sets  of  data  were  reduced  by  the  IBM  70lt  computer  and  error 
rates  computed.  Data  reduction  was  discontinued  after  these  two  runs  when 
the  error  rates  were  found  to  be  far  greater  than  those  produced  by  the  FSK 
equipment  or  mathematically  predicted.  It  was  felt  that  little,  if  any,  in¬ 
formation  would  be  obtained  by  further  data  reduction.  It  was  believed  that 
the  poor  results  of  these  two  runs  justified  the  suspension  of  further  in¬ 
vestigations.  Reasons  for  the  lack  of  correlation  between  mathematically 
predicted  error  rates  and  actual  error  rates  are  discussed  in  the  following 
section. 
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VII.  CONCLUSIONS 


In  general,  the  failure  to  obtain  data  completely  compatible  with 
theory  was  due  to  performance  limitations  of  both  the  FSK  equipment  and  the 
moment  computer. 

From  a  practical  point  of  view,  the  equipment  needed  to  implement 
moment  detection  is  inordinately  conqslicated.  The  computation  of  the  - 
order  moment  by  the  "multiple  definite  integral  method"  requires  the  compu¬ 
tation  of  k  ,+  1  integrals.  This  method,  which  was  used  because  it  seemed  to 
be  the  most  practical,  obtains  the  required  moments  as  the  weighted  sum  and 
difference  ojf  these  integrals.  Since  the  resulting  moment  may  be  of  much 
smaller  magnitude  than  the  various  inputs  of  which  it  is  composed,  it  is  ex¬ 
tremely  sensitive  to  rain  variations  and  drift  of  the  equipment  used  (i.e,, 
tlie  small  differences  of  two  large  numbers  is  very  sensitive  to  small  frac¬ 
tional  changes  of  the  large  numbers).  The  example  given  in  the  Introduction 
of  this  memo  \rtiere  the  computation  of  the  second  moment  of  the  word  1  is  ob¬ 
tained  from  25  -  U5  +  ^  ^  illustrates  this  problem  very  clearly.  Tests  , 

of  the  accuracy  obtained  with  the  experimental  moment  computer  showed  that  ' 
the  values  of  all  moments  were  computed  to  approximately  ±  of  full-scale 
values;  this  accuracy  is  in  accord  with  what  one  can  reasonably  expect  from 
the  type  of  equipment  employed.  Considerably  more  sophisticated  electronic 
circuitry  would  be  needed  to  obtain  much  better  than  1$  of  full-scale  accu¬ 
racy.  Hoirtver,  t  l;d  of  full-scale  errors  are  sufficient  to  cause  errors  in 
the  determination  of  the  reqeived  word.  To  this  computer  error  must  be  added 
the  error  of  the  tape  recorder  which  is  used  to  record  the  moments,  'ihe 
/mpox  tape  recorder  accuracy  is  about  S  1%  cf  full  scale.  This,  too,  can 
give  an  error  in  the  determination  of  the  received  word. 

Because  of  the  t  weighting,  mcmsnt  detection  c  pputatlon  is  very 
seriously  affected  by  deviations  from  ideal  behavior  of  the  associated  com¬ 
munications  equipment,  such  as  d.c.  components  due  to  no  •  inearities  or  gain 
variations . 

The  FSK  equipment  used  in  conjunction  with  thf  .unent  computer  is 
believed  to  be  fairly  representative  of  the  performanc  i-iiat  may  be  expected 
from  noncoherent  FSK  equipment.  Reference  to  Figure  Ul  ’feals  severe  d.c. 
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FIGURE  46  F.S.K.  DISCRIMINATOR  SHIFT  VS  S I ONAL/THERHAL  NOISE 
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shifts  of  both  mark  and  si:a(;e  outputs  with  thermal  noise.  In  addition,  the 
variation  of  the  output  levels  of  both  mark  and  space  with  word  content  is 
clearly  indicated  in  the  accompanyinc  photographs,  Figures  h7a,  b  and  c. 

The  two  horizontal  lines  in  each  photo  are  the  output  levels  obtained  when 
a  steady  mark  and  space  signal  is  received]  the  traces  within  are  the  out¬ 
put  amplitudes  obtained  when  the  words  1,  2  and  5  respectively,  are  sent. 


FIGURE  47a 

OUTPUT  OF  FSK  DISCRIMINATOR, 
FSK  FILTER  CONNECTED, 

WORD  I 


FIGURE  47b 

OUTPUT  OF  FSK  DISCRIMINATOR, 
FSK.  FILTER  CONNE'CTED,- 
WORD  2 


FIGURE  47c 

OUTPUT  OF  FSK  DISCRIMINATOR, 
FSK  FILTER  CONNECTED, 

WORD  S 


FifTT,res  lifa,  b  and  c  indicate  the  difference  in  output  amplitudes 
of  the  FSK  discriminator  when  the  v/ord  1  without  noise  is  sent,  the  word 
31  without  noise  is  sent,  and  when  the  word  31  without  noise  is  sent  when 
the  carrier  filter  of  the  FSK  equipment  is  disabled. 


Figures  li9a,  b  and  c  clearly  indicate  the  assymetrical  noise  out¬ 
put  of  the  i'SK  discriminator  when  thermal  noise  is  inserted  at  the  receiver 
input.  (Comparison  with  Figure  ij  indicates  that  the  noise  at  the  output  of 
the  telephone  line  filter  is  symmetric.)  Again,  the  horizontal  lines  are 
the  output  amplitudes  when  a  steady  marie  and  space  signal  is  sent  without 
noise . 


It  should  bo  noted  that  the  paragraphs  above  are  not  written  in  con¬ 
demnation  of  the  particular  FSK  equipment  used  in  conjunction  with  the  moment 
computer,  wuite  the  contrary;  these  differences  are  of  little  import  in 
normal  FSK  operation  but  are  inherently  very  serious  when  used  with  moment 
detection. 

The  ei^rimental  investigation  has  shown  that  in  order  for  the  moment 
detection  technique  to  be  properlj|  Implemented,  electronic  equipment  of  un¬ 
usual,  and  it  is  felt  impractical, ^  complexity  and  accuracy  is  required.  Fur¬ 
ther,  it  is  found  that  even  if  th^  .jberminal  moment  detection  equipment  were 
ideal >  tho  technique  is  extremely. sensitive  to  gain  variations  and  nonliileari- 
ties  (d.c.  offset)  of  the  associated  communicatlono  equipment.  Moment  detection 
therefore  appears  to  hold  little  promise  as  a  decision  technique  in  a  practical 
communications  system. 
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FIGURE  >^8a 


OUTPUT  OF  F3K  DISCRIMINATOR, 
FSK  FILTER  CONNECTED, 

WORD  I 


FIGURE  48b 

OUTPUT  OF  F3X  DISCRIMINATOR, 
FSK  FILTER  CONNECTED 
WORD  31 


FIGURE  48c  ^ 

OUTPUT  OF  FSK ;:discriminator, 
FSK  FILTER  DISCONNECTED, 

WORD  31 


FIGURE  49a 

;NARX  AND  SPACE 

'output  of  FSK  DISCRIMINATOR, 

"stEADV  NPUT  i- 


FIGURE  49b 

THERMAL  NOISE 

OUTPUT  OF  FSK  DISCRIMINATOR, 
FSK  FILTER  CONNECTED 


FIGURE  49c 

THERMAL  NOISE 

OUTPUT  OF  FSK  DISCRIMINATOR, 
FSK  FILTER  DISCONNECTED 
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APPENDIX 


Difficulties  ISncountered  with  The  FSK  Equipment 


Some  of  the  difficulties  experienced  vith  the  Tele-Signal,  Model 
3000,  FSK  equipment  may  be  of  interest  and  are  listed  belcw. 

1.  Kjctremely  high  error  probabilities  observed  during  early  FSK  teat  •' 

i 

runs  were  found  to  be  due  to  a  partially  shorted  input  traliaformer 
and  a  defective  transistor  V103  in  the  high-speed  network  of  the 
FSK  Receiver. 

2.  After  the  defective  parts  were  replaced,  the  FSK  test  runs  were  re¬ 
peated.  Although  the  error  probabilities  were  greatly  reduced,  they 
were  still  much  higher  than  expected.  The  reason  was  found 

to  be  the  large  ripple  components  on  the  d.c.  output  voltages  from 
the  power  supplies.  Since  reduction  of  the  ripple  components  would  have, 
entailed  equipment  redesign,  the  power  supplies  were  disconnected  and 
the  FSK  aquipnent  was  supplied  with  external,  d.c.  power  during  the 
actual  evaluation. 

3.  As  noted  in  Section  VII  of  this  report,  severe  d.c*  discriminator 
shifts  with  additive  thermal  noise  was  encountered.  Again,  equip¬ 
ment  redesign  would  have  been  necessary  to  correct  this  condition} 
however,  an  attempt  was  made  to  minimize  this  effect  by  adjustment 
of  the  discriminator.  It  is  believed  that  this  d.o.  shift  had  much 
more  serious  effects  on  the  error  probabilities  obtained  wiT,h  moment' 
detection  than  during  normal  FSK  detection. 

U.  In  the  process  of  correcting  and/or  alleviating  those  difficulties, 
many  differences  between  the  schematics  and  the  actual  equipment  were 
noted.  In  prototype  equipment  of  this  kind,  it  is  not  unusual  to  en¬ 
counter  discrepancies  of  this  type  and  in  all  cases  it  was  considered 
that  the  equipment  components  and  wiring  rather  than  the  schematics 
wore  correct. 


Pir>TRIBin-ION  LIST 


n/vnc  (RAUAT) 

Griffiss  AFB,  ’lew  York 

R,Ai:iG  idJ'AT) 

Oriffiss  AFB,  New  York 

RADC  (RAOYL-2) 

Griffiss  AFB,  New  York 

Armed  Gerviocs  Technical  Information  Agency 
Arlington  Hall  Station 
Arlington  12,  Virginia 

ICSD  (CRQSL-1) 

L.  0.  Ilanscom  Field,  Hasaachusetta 

AUL  (AUL-7736) 

Maw'/ell  AFB,  Alabama 

'.f/iDD  (I'A'/AB) 

V/right-Patteraon  AFD,,  Ohio 
Chief 

N^val  Reaearoh  T,aboratory 
'Attn!  Cods  2021 
vTashington  25,  D.  C. 

Air  FOroa  Field  Repreaentative 
Naval  Reaaarch  Laboratory 
Attn!  Code  1010 
Washington  25,  D,  C, 

Commanding  Officer 

U,  S,  Army  Signal  Research  and  Development  Laboratories 

Attn!  SIGRA/SL-ADT 

Fort  Monmouth,  New  Jersey 

Chief 

Bureau  of  Ships 
Attn!  Code  312 
Washington  25,  D.  C. 

Signal  Corps  Idaison  Officer 
IIAT)C1  (RAOI.j  Oapt,  Norton) 

GriffifJD  AFB,  Mew  York 


GEEIA  (ROZl-ISTL,  Techni.oal  Library) 
Griffias  AFB,  New  York 


Chief 

Research  &  Development  Office  of  Chief  Signal  Officer 
Washington  2$,  D.  C. 


RADC  (RAOUA,  Mr.  Malloy) 

Griffias  AFB,  New  York 

AF  Section 
MAAG,  Qennaiiy 

Box  aio 

APO  80 

New  York,  New  York 

I- 

AF  Plant  Representative  Office 
United  States  Air  Force 
Attn:  RCRCA 

General  Electric  Company 
P.  0.  Box  91 
Cincinnati-^,  Ohio -■ 

John  Kelly 
Mitre  Corporation 
Box  20 8 

Lexington  72,  Maes. 

ESD  (3CSD,  Col,  O'Hem) 

L  G  Hans com  Field 
Bedford,  Mass. 

RADC  (RAUO) 

Qrlffiss  AFB,  Now  York 
Mr.  L.  DeRosa 

ITT  Commonicatlon  System,  Inc. 

Garden  State  Plaza 

Routes  U  &■  17,  Params,  New  Jers^ 

ESD  (ESRR,  Colonel  Sheets) 

L  G  Hanscom  Field 
Bedford,  Mass* 

AFSC  (Major  Nowakowskl,  SCSPE) 
Andrews  AFB,  V/ashlngton  2.5,  D.  C. 


